00000001:02000400:1.0F:1787836236.003767:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787836254.922715:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1787836257.156940:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 955 MB/s 00000001:01000000:1.0:1787836257.406841:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 679 MB/s 00000001:01000000:3.0F:1787836257.656327:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2783 MB/s 00000020:02000000:2.0F:1787836258.590465:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_97_gdd6e0cb 00000400:02000000:1.0:1787836259.475287:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.125@tcp [8/256/0/180] 00008000:02000000:2.0:1787836262.805688:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787836315.414665:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787836323.889012:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787836323.889017:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787836323.889149:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c93f335d 00000080:02000400:1.0:1787836323.889161:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787836323.896595:0:5822:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787836323.896609:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787836323.896647:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ab819d5d) 00000020:00000080:1.0:1787836323.896666:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787836323.911615:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787836323.911997:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787836323.934333:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787836323.934377:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787836323.934400:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787836323.934537:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787836323.934563:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787836323.934921:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787836323.934929:0:5822:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787836323.934939:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab7161 00000020:01000004:2.0:1787836323.934947:0:5822:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787836323.934952:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787836323.934957:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c93f335d from MGS 00000020:01000004:2.0:1787836323.934961:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787836323.934986:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000046137e70) 00000020:00000080:2.0:1787836323.934999:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787836323.935199:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c93f335d from MGS, refs=2 00080000:01000000:2.0:1787836323.935206:0:5822:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787836323.935211:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab716f 00000100:00100000:2.0:1787836323.935301:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787836323.935514:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787836323.935521:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787836323.936011:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787836323.936017:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787836323.936976:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836323.937521:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787836323.937528:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787836323.938324:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787836323.938332:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787836323.938908:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787836323.938916:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787836323.939604:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836323.939608:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836323.939609:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836323.939816:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836323.939818:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836323.939820:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836323.940671:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787836323.946336:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787836324.190300:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3551 MB/s 00000001:01000000:3.0:1787836324.440762:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3835 MB/s 00000001:01000000:2.0:1787836324.690450:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 387 MB/s 00000001:01000000:3.0:1787836324.940369:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 651 MB/s 00080000:10000000:3.0:1787836324.955976:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787836324.974452:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787836324.977530:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787836324.977636:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787836324.977640:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787836324.978410:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787836324.978555:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787836324.978608:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787836324.979040:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787836324.979118:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787836324.979632:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836324.980809:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787836324.980819:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787836324.985710:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787836324.985728:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787836324.986226:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787836324.986234:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787836324.986986:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787836324.987006:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.125@tcp' 00000020:01000004:2.0:1787836324.987008:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787836324.987088:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.125@tcp (typ=mgc) 00000020:00000080:2.0:1787836324.987101:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.125@tcp (000000000dd302ed) 00000020:00000080:2.0:1787836324.987117:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787836324.987189:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000fd584fe@MGC192.168.203.125@tcp: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1787836324.987365:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.125@tcp-0 is initialized 00000040:01000000:2.0:1787836324.987372:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787836324.987551:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787836324.999038:0:5839:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787836324.999097:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.125@tcp (uuid 2e8e7a0a-4610-42c5-99e6-210da529f97c) 00000020:00000080:1.0:1787836324.999130:0:5822:0:(genops.c:1385:class_connect()) connect: client 2e8e7a0a-4610-42c5-99e6-210da529f97c, cookie 0x966835ea68ab717d 00000100:00080000:1.0:1787836324.999143:0:5822:0:(import.c:510:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787836324.999148:0:5822:0:(import.c:624:import_select_connection()) MGC192.168.203.125@tcp: import 000000000fd584fe using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1787836324.999178:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000019fa8d51 x1874682193117312/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787836324.999213:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS 00000020:01000004:1.0:1787836324.999233:0:5822:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787836324.999237:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787836324.999249:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a8adc8e3) 00000020:00000080:1.0:1787836324.999260:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787836324.999329:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019fa8d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8e7a0a-4610-42c5-99e6-210da529f97c:3309:1874682193117312:0@lo:250: 00000100:00100000:3.0:1787836324.999401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.007692:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193117312 00000100:00100000:1.0:1787836325.007705:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193117312 00000100:00100000:1.0:1787836325.007756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836325.007763:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c26244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874682193117312:12345-0@lo:250: 00010000:00080000:1.0:1787836325.008021:0:5833:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 2e8e7a0a-4610-42c5-99e6-210da529f97c@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1787836325.008047:0:5833:0:(genops.c:1385:class_connect()) connect: client 2e8e7a0a-4610-42c5-99e6-210da529f97c, cookie 0x966835ea68ab718b 00000100:00080000:1.0:1787836325.008384:0:5833:0:(import.c:65:import_set_state_nolock()) 000000009309283d : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836325.008582:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c26244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:3309:x1874682193117312:12345-0@lo:250: Request processed in 817us (9180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836325.008590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787836325.008919:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787836325.008928:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.125@tcp: connect to target with instance 0 00000100:00080000:3.0:1787836325.008935:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787836325.008939:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787836325.008943:0:3309:0:(import.c:65:import_set_state_nolock()) 000000000fd584fe MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787836325.008945:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787836325.008960:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787836325.008965:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019fa8d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8e7a0a-4610-42c5-99e6-210da529f97c:3309:1874682193117312:0@lo:250: 00000100:00100000:2.0:1787836325.020169:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836325.020370:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787836325.020377:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787836325.021171:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787836325.021178:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787836325.024355:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787836325.024369:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787836325.025112:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836325.025295:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787836325.025300:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787836325.026506:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787836325.026517:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787836325.095705:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836325.095921:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787836325.095927:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787836325.099374:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787836325.099390:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787836325.100378:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836325.100599:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787836325.100612:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787836325.102760:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787836325.102771:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787836325.103354:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836325.103529:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787836325.103537:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787836325.109345:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787836325.109360:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787836325.111459:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787836325.111646:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787836325.111736:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787836325.114954:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787836325.114970:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787836325.172385:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836325.172754:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787836325.172761:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787836325.178199:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787836325.178219:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787836325.182011:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787836325.182027:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787836325.183660:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787836325.183686:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787836325.183693:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787836325.183824:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787836325.183884:0:5822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787836325.183888:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787836325.183890:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787836325.183891:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836325.183892:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836325.183893:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836325.183895:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836325.183896:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787836325.183897:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787836325.183898:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787836325.183900:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787836325.183901:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836325.183902:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787836325.183904:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787836325.183906:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787836325.183907:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787836325.183908:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836325.183909:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836325.183910:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836325.183911:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836325.183912:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787836325.184174:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787836325.184176:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787836325.184177:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787836325.184178:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836325.184179:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787836325.184206:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787836325.184222:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061e776a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117440:0@lo:253: 00000100:00100000:2.0:1787836325.184303:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836325.184355:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e972a039 going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.184975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193117440 00000100:00100000:0.0:1787836325.184984:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193117440 00000100:00100000:0.0:1787836325.185049:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787836325.185078:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002809d550 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:5822:x1874682193117440:12345-0@lo:253: 20000000:01000000:0.0:1787836325.185127:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787836325.185131:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787836325.185522:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787836325.185599:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787836325.185879:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787836325.197403:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787836325.197662:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787836325.197666:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787836325.197672:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787836325.197674:0:5836:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787836325.197688:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787836325.198911:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787836325.199143:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787836325.199156:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787836325.199204:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787836325.199255:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787836325.199294:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787836325.199415:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787836325.199424:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787836325.199472:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787836325.199480:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787836325.199511:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787836325.199519:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787836325.199546:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787836325.199604:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787836325.199650:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787836325.199656:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787836325.199669:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787836325.199854:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787836325.199864:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787836325.199900:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787836325.199931:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787836325.199978:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787836325.199989:0:5836:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787836325.200081:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787836325.200091:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787836325.200138:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787836325.200174:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787836325.200207:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787836325.200218:0:5836:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787836325.200308:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787836325.200317:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787836325.200348:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787836325.200380:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787836325.200569:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787836325.200620:0:5836:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787836325.200627:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787836325.201372:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787836325.201692:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787836325.201714:0:5836:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.125@tcp for mdt 20000000:01000000:1.0:1787836325.201716:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787836325.201751:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787836325.201758:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787836325.201788:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787836325.201797:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:1.0:1787836325.202403:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787836325.202423:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787836325.202475:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787836325.202522:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787836325.202618:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787836325.202622:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787836325.202627:0:5836:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787836325.202633:0:5836:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787836325.203232:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1787836325.203394:0:5836:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787836325.211587:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787836325.211637:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787836325.211710:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787836325.211729:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787836325.211731:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787836325.211734:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787836325.211747:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787836325.211750:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787836325.211776:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787836325.211779:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787836325.212713:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1787836325.212999:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1787836325.213049:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1787836325.213374:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1787836325.213390:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787836325.213392:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787836325.214345:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787836325.214647:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787836325.214686:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787836325.214735:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787836325.214751:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787836325.214753:0:5836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1787836325.214760:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787836325.214778:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214793:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214802:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214808:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214814:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214821:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214827:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eae98b9d already unused, calling callback (0000000009fc7190) 00010000:00010000:0.0:1787836325.214830:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214835:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214846:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214853:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.214930:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eae98b9d/0x966835ea68ab7192 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787836325.214946:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787836325.403106:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002809d550 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:5822:x1874682193117440:12345-0@lo:253: Request processed in 218035us (218790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836325.403125:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787836325.403276:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061e776a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117440:0@lo:253: 10000000:01000000:0.0:1787836325.403291:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787836325.403294:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787836325.403296:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787836325.403297:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836325.403298:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787836325.403300:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836325.403301:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836325.403302:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787836325.403304:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787836325.403305:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787836325.403306:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836325.403307:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787836325.403330:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c93f335d from lustre-MDT0000 10000000:01000000:0.0:1787836325.403359:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787836325.403362:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787836325.403367:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98e3c7faced8 10000000:01000000:0.0:1787836325.403371:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787836325.403377:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e3c7faced8 from 1 10000000:01000000:0.0:1787836325.403380:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787836325.403413:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.403423:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.403431:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836325.403464:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ae270c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117568:0@lo:101: 00000100:00100000:0.0:1787836325.403495:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836325.403546:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9b4b794 going to sleep for 11 seconds 00000100:00100000:1.0:1787836325.403643:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193117568 00000100:00100000:1.0:1787836325.403649:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193117568 00000100:00100000:1.0:1787836325.403693:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836325.403700:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082c13829 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:5822:x1874682193117568:12345-0@lo:101: 00010000:00010000:1.0:1787836325.403713:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836325.403725:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7199 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.403747:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7199 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.403756:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7199 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.403765:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d64b3d83, rc 0) 00000100:00100000:1.0:1787836325.403803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082c13829 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+6:5822:x1874682193117568:12345-0@lo:101: Request processed in 104us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836325.403818:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787836325.403994:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ae270c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117568:0@lo:101: 00010000:00010000:0.0:1787836325.404006:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.404014:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836325.404085:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ae270c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117696:0@lo:501: 00000100:00100000:0.0:1787836325.404122:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836325.404147:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9b4b794 going to sleep for 11 seconds 00000100:00100000:2.0:1787836325.404252:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193117696 00000100:00100000:2.0:1787836325.404257:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193117696 00000100:00100000:2.0:1787836325.404278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836325.404284:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c89fbe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+6:5822:x1874682193117696:12345-0@lo:501: 00000100:00100000:2.0:1787836325.404515:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c89fbe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+6:5822:x1874682193117696:12345-0@lo:501: Request processed in 231us (392us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787836325.404522:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787836325.404646:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ae270c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117696:0@lo:501: 10000000:01000000:0.0:1787836325.404673:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787836325.404690:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.404698:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836325.404705:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e3ce1d0800 10000000:01000000:0.0:1787836325.404709:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787836325.404713:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98e3ce1d0800 10000000:01000000:0.0:1787836325.404716:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787836325.404718:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98e3ce1d0800 from 1 10000000:01000000:0.0:1787836325.404727:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787836325.404746:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000001a494afe/0x966835ea68ab71a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.404753:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000001a494afe/0x966835ea68ab71a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.404759:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000001a494afe/0x966835ea68ab71a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836325.404770:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ae270c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117824:0@lo:101: 00000100:00100000:0.0:1787836325.404796:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836325.404853:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9b4b794 going to sleep for 11 seconds 00000100:00100000:2.0:1787836325.405210:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193117824 00000100:00100000:2.0:1787836325.405216:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193117824 00000100:00100000:0.0:1787836325.405358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787836325.405366:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3ba47fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+6:5822:x1874682193117824:12345-0@lo:101: 00010000:00010000:0.0:1787836325.405374:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836325.405386:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d34596d1/0x966835ea68ab71ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab71a7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.405404:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d34596d1/0x966835ea68ab71ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab71a7 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.405411:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d34596d1/0x966835ea68ab71ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab71a7 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.405418:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d34596d1, rc 0) 00000100:00100000:0.0:1787836325.405502:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3ba47fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+7:5822:x1874682193117824:12345-0@lo:101: Request processed in 138us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.405508:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836325.405568:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ae270c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117824:0@lo:101: 00010000:00010000:1.0:1787836325.405583:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000001a494afe/0x966835ea68ab71a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.405591:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000001a494afe/0x966835ea68ab71a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836325.405604:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787836325.405620:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000001a494afe/0x966835ea68ab71a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.405627:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000001a494afe/0x966835ea68ab71a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836325.405634:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787836325.405638:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787836325.405643:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98e3ce1d0800 10000000:01000000:1.0:1787836325.405645:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787836325.405648:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787836325.405651:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787836325.405668:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.405674:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.405681:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836325.405709:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117952:0@lo:101: 00000100:00100000:1.0:1787836325.405738:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.405963:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018f7754c going to sleep for 11 seconds 00000100:00100000:2.0:1787836325.406038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193117952 00000100:00100000:2.0:1787836325.406043:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193117952 00000100:00100000:0.0:1787836325.406220:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787836325.406234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caa89784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+7:5822:x1874682193117952:12345-0@lo:101: 00010000:00010000:0.0:1787836325.406242:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836325.406251:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab71b5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.406265:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.406273:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.406279:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053f4841c, rc 0) 00000100:00100000:0.0:1787836325.406319:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caa89784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+8:5822:x1874682193117952:12345-0@lo:101: Request processed in 86us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.406326:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836325.406401:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193117952:0@lo:101: 00010000:00010000:1.0:1787836325.406414:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.406420:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836325.406467:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118080:0@lo:501: 00000100:00100000:1.0:1787836325.406492:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.406517:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018f7754c going to sleep for 11 seconds 00000100:00100000:2.0:1787836325.406564:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193118080 00000100:00100000:2.0:1787836325.406568:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193118080 00000100:00100000:2.0:1787836325.406588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787836325.406593:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d787548b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+8:5822:x1874682193118080:12345-0@lo:501: 00000100:00100000:2.0:1787836325.406983:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d787548b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:5822:x1874682193118080:12345-0@lo:501: Request processed in 389us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836325.406990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787836325.407229:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118080:0@lo:501: 00000100:00100000:1.0:1787836325.407261:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118208:0@lo:503: 00000100:00100000:1.0:1787836325.407301:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.407367:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018f7754c going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.407404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193118208 00000100:00100000:0.0:1787836325.407410:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193118208 00000100:00100000:0.0:1787836325.407479:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787836325.407486:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bf1841c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:5822:x1874682193118208:12345-0@lo:503: 00000100:00100000:0.0:1787836325.407651:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bf1841c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:5822:x1874682193118208:12345-0@lo:503: Request processed in 166us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.407658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787836325.407789:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118208:0@lo:503: 00000100:00100000:1.0:1787836325.408490:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:5865:1874682193118336:0@lo:502: 00000100:00100000:1.0:1787836325.408535:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.408577:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000003fd11c4a going to sleep for 11 seconds 00000100:00100000:3.0:1787836325.408632:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193118336 00000100:00100000:3.0:1787836325.408638:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193118336 00000100:00100000:3.0:1787836325.408689:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787836325.408698:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c9bdda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:5865:x1874682193118336:12345-0@lo:502: 00000100:00100000:3.0:1787836325.408888:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c9bdda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:5865:x1874682193118336:12345-0@lo:502: Request processed in 192us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836325.408895:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787836325.409038:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:5865:1874682193118336:0@lo:502: 00000020:01000000:1.0:1787836325.409092:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836325.409112:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836325.409121:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787836325.409126:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787836325.409129:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787836325.409143:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000040264e73) 00000020:00000080:1.0:1787836325.409160:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787836325.409165:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787836325.409232:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787836325.409239:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab71ca 00000020:00000080:1.0:1787836325.409459:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787836325.409464:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836325.409467:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836325.409469:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787836325.409471:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836325.409475:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836325.409476:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787836325.409479:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787836325.409486:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005aec2705) 00000020:00000080:1.0:1787836325.409496:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787836325.409499:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787836325.409500:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787836325.409503:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787836325.409508:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787836325.409547:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c93f335d from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787836325.409575:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005f6c437f) 00000020:00000080:1.0:1787836325.409585:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787836325.409645:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787836325.409650:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab71df 00000020:00000080:1.0:1787836325.409748:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787836325.409754:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787836325.409759:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x966835ea68ab71e6 00080000:01000000:1.0:1787836325.409764:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787836325.409767:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab71ed 00080000:10000000:1.0:1787836325.410186:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787836325.410391:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787836325.414953:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787836325.474774:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787836325.475329:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787836325.478023:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787836325.478472:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787836325.504491:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000043f3f898) 00000020:00000080:1.0:1787836325.504513:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787836325.504604:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787836325.504611:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab71fb 00000020:00000080:2.0:1787836325.505124:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787836325.506755:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836325.561636:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787836325.588835:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787836325.619964:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787836325.651393:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787836325.695872:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787836325.727635:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x966835ea68ab7202 00000020:00000080:3.0:1787836325.728002:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787836325.728013:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836325.728019:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836325.728022:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787836325.728025:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836325.728031:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836325.728032:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787836325.728036:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787836325.728093:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787836325.728187:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836325.728192:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836325.728193:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787836325.728195:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836325.728198:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836325.728199:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787836325.728208:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787836325.728210:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787836325.728250:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:5865:1874682193118464:0@lo:502: 00000100:00100000:3.0:1787836325.728322:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836325.728388:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000900181c5 going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.728495:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193118464 00000100:00100000:0.0:1787836325.728503:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193118464 00000100:00100000:0.0:1787836325.728595:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787836325.728603:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8784aa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:5865:x1874682193118464:12345-0@lo:502: 00000100:00100000:0.0:1787836325.728973:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8784aa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:5865:x1874682193118464:12345-0@lo:502: Request processed in 371us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.728981:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787836325.729215:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:5865:1874682193118464:0@lo:502: 00000020:01000000:3.0:1787836325.729244:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836325.729249:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836325.729250:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787836325.729254:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787836325.729374:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787836325.729392:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787836325.729406:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.729416:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836325.729424:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e3ce1d0800 from 1 10000000:01000000:3.0:1787836325.729426:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787836325.729454:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.729461:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.729470:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836325.729484:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118592:0@lo:101: 00000100:00100000:3.0:1787836325.729523:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836325.729827:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000900181c5 going to sleep for 11 seconds 00000100:00100000:2.0:1787836325.729906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193118592 00000100:00100000:2.0:1787836325.729913:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193118592 00000100:00100000:2.0:1787836325.729944:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787836325.729951:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ae1f1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:5822:x1874682193118592:12345-0@lo:101: 00010000:00010000:2.0:1787836325.729970:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836325.729986:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7209 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836325.730007:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7209 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836325.730018:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7209 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836325.730025:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea68e5a8, rc 0) 00000100:00100000:3.0:1787836325.730225:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118592:0@lo:101: 00010000:00010000:3.0:1787836325.730239:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.730248:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836325.730827:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118720:0@lo:256: 00000100:00100000:3.0:1787836325.730873:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836325.730896:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000900181c5 going to sleep for 11 seconds 00000100:00100000:2.0:1787836325.731010:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ae1f1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:5822:x1874682193118592:12345-0@lo:101: Request processed in 145us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836325.731018:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787836325.731050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193118720 00000100:00100000:2.0:1787836325.731055:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193118720 00000100:00100000:2.0:1787836325.731117:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787836325.731122:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f714377e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:5822:x1874682193118720:12345-0@lo:256: 20000000:01000000:2.0:1787836325.731135:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787836325.731140:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787836325.731201:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f714377e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:5822:x1874682193118720:12345-0@lo:256: Request processed in 79us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836325.731207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787836325.731366:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118720:0@lo:256: 10000000:01000000:3.0:1787836325.732019:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787836325.732046:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.732056:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836325.732168:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3ce1d0800 from 1 10000000:01000000:3.0:1787836325.732172:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787836325.732204:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.732211:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.732218:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836325.732242:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118848:0@lo:101: 00000100:00100000:3.0:1787836325.732284:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836325.732317:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000900181c5 going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.732382:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193118848 00000100:00100000:0.0:1787836325.732388:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193118848 00000100:00100000:0.0:1787836325.732421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787836325.732427:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004404a947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:5822:x1874682193118848:12345-0@lo:101: 00010000:00010000:0.0:1787836325.732436:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836325.732449:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7217 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.732470:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7217 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.732479:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7217 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.732487:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b977f84, rc 0) 00000100:00100000:0.0:1787836325.732529:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004404a947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5822:x1874682193118848:12345-0@lo:101: Request processed in 102us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.732535:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787836325.732749:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118848:0@lo:101: 00010000:00010000:3.0:1787836325.732763:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.732771:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836325.732819:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118976:0@lo:501: 00000100:00100000:3.0:1787836325.732842:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836325.732862:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000900181c5 going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.732910:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193118976 00000100:00100000:0.0:1787836325.732914:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193118976 00000100:00100000:0.0:1787836325.732940:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787836325.732945:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2f42cce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5822:x1874682193118976:12345-0@lo:501: 00000100:00100000:0.0:1787836325.733724:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2f42cce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5822:x1874682193118976:12345-0@lo:501: Request processed in 777us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.733732:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787836325.733864:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193118976:0@lo:501: 00000100:00100000:3.0:1787836325.733901:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193119104:0@lo:503: 00000100:00100000:3.0:1787836325.733938:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836325.733960:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000900181c5 going to sleep for 11 seconds 00000100:00100000:2.0:1787836325.734013:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193119104 00000100:00100000:2.0:1787836325.734018:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193119104 00000100:00100000:2.0:1787836325.734053:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787836325.734087:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d4ef5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5822:x1874682193119104:12345-0@lo:503: 00000040:00080000:2.0:1787836325.734205:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787836325.734254:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d4ef5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5822:x1874682193119104:12345-0@lo:503: Request processed in 169us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836325.734261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787836325.734398:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193119104:0@lo:503: 00000040:00080000:3.0:1787836325.735716:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787836325.735889:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787836325.735906:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787836325.735965:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.735977:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836325.736024:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787836325.736027:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e3ce1d0800 10000000:01000000:0.0:1787836325.736030:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e3ce1d0800 10000000:01000000:0.0:1787836325.736033:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787836325.736038:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3ce1d0800 from 1 10000000:01000000:0.0:1787836325.736041:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787836325.736207:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.736216:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.736225:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836325.736247:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009741f9ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193119232:0@lo:101: 00000100:00100000:0.0:1787836325.736300:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836325.736343:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d32372ba going to sleep for 11 seconds 00000100:00100000:3.0:1787836325.736388:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193119232 00000100:00100000:3.0:1787836325.736394:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193119232 00000100:00100000:3.0:1787836325.736435:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787836325.736443:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1f883df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5822:x1874682193119232:12345-0@lo:101: 00010000:00010000:3.0:1787836325.736454:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836325.736468:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7225 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.736501:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7225 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.736511:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7225 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.736519:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000927da5b9, rc 0) 00000100:00100000:3.0:1787836325.736573:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1f883df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5822:x1874682193119232:12345-0@lo:101: Request processed in 131us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836325.736580:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787836325.736758:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009741f9ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193119232:0@lo:101: 00010000:00010000:1.0:1787836325.736773:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.736781:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836325.736831:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193119360:0@lo:501: 00000100:00100000:1.0:1787836325.736858:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.736881:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013305318 going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.736932:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193119360 00000100:00100000:0.0:1787836325.736936:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193119360 00000100:00100000:0.0:1787836325.736965:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787836325.736971:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a798637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5822:x1874682193119360:12345-0@lo:501: 00000100:00100000:0.0:1787836325.737253:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a798637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5822:x1874682193119360:12345-0@lo:501: Request processed in 281us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.737261:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787836325.737436:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193119360:0@lo:501: 00000100:00100000:1.0:1787836325.737465:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193119488:0@lo:503: 00000100:00100000:1.0:1787836325.737506:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.737537:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013305318 going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.737660:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193119488 00000100:00100000:0.0:1787836325.737665:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193119488 00000100:00100000:0.0:1787836325.737700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787836325.737707:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b71726be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5822:x1874682193119488:12345-0@lo:503: 00000100:00100000:0.0:1787836325.738021:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b71726be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5822:x1874682193119488:12345-0@lo:503: Request processed in 315us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.738028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787836325.738266:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193119488:0@lo:503: 00000100:00100000:1.0:1787836325.738825:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:5870:1874682193119616:0@lo:502: 00000100:00100000:1.0:1787836325.738869:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.738937:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c27ae777 going to sleep for 11 seconds 00000100:00100000:3.0:1787836325.738974:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193119616 00000100:00100000:3.0:1787836325.738980:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193119616 00000100:00100000:3.0:1787836325.739046:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787836325.739053:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ba9b29f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5870:x1874682193119616:12345-0@lo:502: 00000100:00100000:3.0:1787836325.739498:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ba9b29f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5870:x1874682193119616:12345-0@lo:502: Request processed in 445us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836325.739506:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787836325.739590:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:5870:1874682193119616:0@lo:502: 00000020:01000004:1.0:1787836325.739655:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787836325.739669:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001a494cdd) 00000020:00000080:1.0:1787836325.739686:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787836325.739764:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c93f335d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787836325.739768:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c93f335d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787836325.739771:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c93f335d 4 00010000:00080000:1.0:1787836325.739798:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c15bc084@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1787836325.741451:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787836325.741690:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787836325.741724:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787836325.741737:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x966835ea68ab723a 00000100:00080000:1.0:1787836325.741748:0:5870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787836325.741753:0:5870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c15bc084 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1787836325.741795:0:5870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fafed180 x1874682193119744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787836325.741844:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193119744:0@lo:38: 00000100:00100000:1.0:1787836325.741924:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787836325.741992:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787836325.745683:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193119744 00000100:00100000:1.0:1787836325.745698:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193119744 00000100:00100000:1.0:1787836325.745746:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836325.745752:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdaae20c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874682193119744:12345-0@lo:38: 00000100:00100000:1.0:1787836325.745846:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdaae20c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874682193119744:12345-0@lo:38: Request processed in 92us (3923us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787836325.745853:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836325.745920:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787836325.745928:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000c15bc084 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787836325.745932:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787836325.745943:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193119744:0@lo:38: 00000100:00100000:0.0:1787836325.748705:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001187de47 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:5870:1874682193119872:0@lo:502: 00000100:00100000:0.0:1787836325.748804:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836325.748845:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193119872 00000100:00100000:0.0:1787836325.748852:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193119872 00000100:00100000:0.0:1787836325.748895:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787836325.748903:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b3102da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5870:x1874682193119872:12345-0@lo:502: 00000100:00100000:0.0:1787836325.749135:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b3102da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5870:x1874682193119872:12345-0@lo:502: Request processed in 232us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.749143:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787836325.749202:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8d5f915 going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.749221:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001187de47 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:5870:1874682193119872:0@lo:502: 00000040:00080000:0.0:1787836325.749262:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787836325.749949:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787836325.749968:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787836325.750023:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.750034:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787836325.750130:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787836325.750137:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787836325.750138:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836325.750139:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836325.750140:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836325.750141:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836325.750143:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787836325.750144:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787836325.750145:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787836325.750146:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787836325.750147:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836325.750149:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787836325.750152:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787836325.750154:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787836325.750156:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787836325.750157:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836325.750158:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836325.750159:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836325.750160:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836325.750160:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787836325.750161:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787836325.750162:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787836325.750163:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787836325.750164:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836325.750164:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787836325.750183:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787836325.750194:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193120000:0@lo:253: 00000100:00100000:3.0:1787836325.750236:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836325.750274:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b21375d6 going to sleep for 11 seconds 00000100:00100000:0.0:1787836325.750447:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193120000 00000100:00100000:0.0:1787836325.750453:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193120000 00000100:00100000:0.0:1787836325.750520:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787836325.750528:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e95f0612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5822:x1874682193120000:12345-0@lo:253: 20000000:01000000:0.0:1787836325.750568:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787836325.750581:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787836325.775543:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787836325.775567:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787836325.776016:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787836325.776022:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787836325.776043:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.776153:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7209 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.776162:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.776203:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7209 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.776219:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7209 expref: 12 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836325.776235:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874682193120128:0@lo:104: 00000100:00100000:1.0:1787836325.776462:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836325.776564:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bd0a2d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787836325.779029:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193120128 00000100:00100000:2.0:1787836325.779046:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193120128 00000100:00100000:2.0:1787836325.779126:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787836325.779135:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c10c6694 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5857:x1874682193120128:12345-0@lo:104: 00010000:00010000:2.0:1787836325.779152:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836325.779246:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787836325.779423:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c10c6694 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5857:x1874682193120128:12345-0@lo:104: Request processed in 289us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836325.779431:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836325.779807:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874682193120128:0@lo:104: 00010000:00010000:1.0:1787836325.779832:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.779850:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836325.779855:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.779862:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a3e0da37 already unused, calling callback (00000000d52b5b57) 10000000:00010000:1.0:1787836325.779881:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.779889:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836325.779894:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836325.779899:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836325.780498:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.780508:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836325.780524:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.780530:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000a3e0da37/0x966835ea68ab7209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7210 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836325.780545:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836325.780546:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836325.780548:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836325.780607:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836325.780621:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193120256:0@lo:103: 00000100:00100000:1.0:1787836325.780668:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836325.780867:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193120256 00000100:00100000:0.0:1787836325.780873:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193120256 00010000:00010000:0.0:1787836325.780896:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7209 expref: 13 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836325.780927:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836325.780935:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038191aa4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3310:x1874682193120256:12345-0@lo:103: 00010000:00010000:0.0:1787836325.780947:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836325.780950:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7209 expref: 13 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.780960:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7209 expref: 13 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.780974:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea68e5a8/0x966835ea68ab7210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7209 expref: 13 pid: 5836 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.780987:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.780995:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787836325.781013:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004990709s 00010000:00010000:0.0:1787836325.781017:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.781038:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.781045:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.781051:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.781090:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010526217 already unused, calling callback (0000000009fc7190) 00010000:00010000:0.0:1787836325.781212:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.781220:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.781239:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.781339:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.781348:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836325.781353:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010526217/0x966835ea68ab7241 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836325.781389:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836325.781440:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038191aa4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:3310:x1874682193120256:12345-0@lo:103: Request processed in 505us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.781447:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787836325.781725:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193120256:0@lo:103: 00000100:00100000:0.0:1787836325.788501:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e95f0612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5822:x1874682193120000:12345-0@lo:253: Request processed in 37966us (38256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836325.788517:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787836325.788600:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003951cbba pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:5822:1874682193120000:0@lo:253: 10000000:01000000:3.0:1787836325.788616:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787836325.788619:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787836325.788621:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787836325.788622:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836325.788624:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836325.788625:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836325.788626:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836325.788627:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787836325.788629:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787836325.788630:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787836325.788632:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787836325.788633:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836325.788634:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787836325.788648:0:5822:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787836325.796624:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836325.797367:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836325.797623:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836325.797801:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836325.798207:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836325.798388:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836325.799397:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836325.799601:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836325.799847:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836325.800232:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836325.800467:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836325.800677:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787836325.841385:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787836325.874222:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787836325.874482:0:5875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787836325.874487:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787836325.874574:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787836325.883435:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787836325.885617:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787836325.886822:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787836325.886836:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787836325.887394:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787836325.888972:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787836325.889819:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787836325.889870:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787836325.890224:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787836325.890423:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787836325.891761:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787836325.891952:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787836325.892138:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787836325.892319:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787836325.892478:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787836325.892650:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787836325.892818:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787836325.892973:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787836325.893149:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787836325.893297:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787836325.893455:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787836325.898279:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787836325.898489:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787836325.898663:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787836325.898818:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787836325.900007:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787836325.900499:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787836325.900685:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787836325.900814:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787836325.903313:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787836325.903502:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787836325.903680:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787836325.903819:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787836325.905438:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787836325.905632:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787836325.905789:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787836325.906018:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787836325.906294:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787836325.906435:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787836325.906602:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787836325.906754:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787836325.907192:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787836325.907417:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787836325.936224:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787836325.989449:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787836325.989487:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0bac1c77988 00100000:10000000:3.0:1787836325.989495:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787836325.991027:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787836325.991043:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787836325.991055:0:5822:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787836325.991125:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787836326.011401:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787836326.052682:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787836326.052770:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1787836326.052775:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787836327.023045:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836328.048679:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836329.070441:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836330.095633:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787836330.242984:0:6119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787836331.119481:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787836331.254977:0:1360:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787836331.254994:0:1360:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787836331.254997:0:1360:0:(import.c:65:import_set_state_nolock()) 00000000c15bc084 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787836331.255007:0:1360:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c15bc084 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1787836331.255029:0:1360:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003697670c x1874682193120512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787836331.255108:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003697670c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193120512:0@lo:38: 00000100:00100000:1.0:1787836331.255188:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836331.255285:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193120512 00000100:00100000:1.0:1787836331.255292:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193120512 00000100:00100000:1.0:1787836331.255321:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787836331.255327:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059d5a4e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874682193120512:12345-0@lo:38: 00010000:00080000:1.0:1787836331.255349:0:5842:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1787836331.255377:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x966835ea68ab7248 00000004:00100000:1.0:1787836331.255413:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787836331.255536:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df67b307 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193120384:0@lo:400: 00000100:00080000:1.0:1787836331.255536:0:5842:0:(import.c:65:import_set_state_nolock()) 0000000065251b68 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787836331.255568:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836331.255578:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059d5a4e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874682193120512:12345-0@lo:38: Request processed in 251us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836331.255586:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787836331.255597:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193120384 00000100:00100000:2.0:1787836331.255601:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193120384 00000100:00100000:2.0:1787836331.255627:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787836331.255632:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ff07677 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:3312:x1874682193120384:12345-0@lo:400: 00010000:00080000:1.0:1787836331.255637:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003697670c x1874682193120512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787836341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787836331.255650:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787836331.255656:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787836331.255660:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787836331.255661:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000c15bc084 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787836331.255663:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ff07677 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:3312:x1874682193120384:12345-0@lo:400: Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836331.255666:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003697670c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193120512:0@lo:38: 00000100:00100000:2.0:1787836331.255668:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787836331.255699:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df67b307 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193120384:0@lo:400: 00010000:00010000:0.0:1787836332.142540:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836333.171347:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787836333.294277:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787836333.294287:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e3ce1d0800 from 3 10000000:01000000:2.0:1787836333.294294:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787836333.294361:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000ec75fa83/0x966835ea68ab724f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836333.294374:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000ec75fa83/0x966835ea68ab724f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836333.294386:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000ec75fa83/0x966835ea68ab724f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836333.294414:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec18fedb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193120640:0@lo:101: 00000100:00100000:2.0:1787836333.294523:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836333.294591:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d218091 going to sleep for 11 seconds 00000100:00100000:0.0:1787836333.294658:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193120640 00000100:00100000:0.0:1787836333.294666:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193120640 00000100:00100000:0.0:1787836333.294717:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787836333.294727:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039e650fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5839:x1874682193120640:12345-0@lo:101: 00010000:00010000:0.0:1787836333.294739:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836333.294752:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b1f44e8/0x966835ea68ab7256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab724f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836333.294774:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b1f44e8/0x966835ea68ab7256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab724f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836333.294784:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b1f44e8/0x966835ea68ab7256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab724f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836333.294792:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b1f44e8, rc 0) 00000100:00100000:0.0:1787836333.294839:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039e650fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193120640:12345-0@lo:101: Request processed in 114us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836333.294845:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787836333.294967:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec18fedb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193120640:0@lo:101: 00010000:00010000:3.0:1787836333.294981:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000ec75fa83/0x966835ea68ab724f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836333.294988:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000ec75fa83/0x966835ea68ab724f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836333.295038:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ddf55f65 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193120768:0@lo:256: 00000100:00100000:3.0:1787836333.295102:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836333.295128:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090e3e679 going to sleep for 11 seconds 00000100:00100000:1.0:1787836333.295176:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193120768 00000100:00100000:1.0:1787836333.295181:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193120768 00000100:00100000:1.0:1787836333.295203:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787836333.295208:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d09032b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193120768:12345-0@lo:256: 20000000:01000000:1.0:1787836333.295220:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787836333.295234:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787836333.295237:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787836333.295320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d09032b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193120768:12345-0@lo:256: Request processed in 112us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836333.295327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787836333.295517:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ddf55f65 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193120768:0@lo:256: 10000000:01000000:3.0:1787836333.295559:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787836333.295564:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000ec75fa83/0x966835ea68ab724f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836333.295571:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000ec75fa83/0x966835ea68ab724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836334.190358:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787836334.868389:0:6321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea87c5cc0 20000000:00000080:1.0:1787836334.868411:0:6321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e3d84d9400 uarg=0000000000000000 20000000:01000000:1.0:1787836334.868456:0:6321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787836334.868462:0:6321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787836334.868466:0:6321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787836334.871789:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787836334.871807:0:6321:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787836334.878637:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787836334.879021:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787836334.880286:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787836334.880375:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787836334.880397:0:6321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787836334.880414:0:6321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836334.880525:0:6321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7217 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836334.880534:0:6321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836334.880575:0:6321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7217 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836334.880593:0:6321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7217 expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836334.880608:0:6321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099a11d0e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1874682193120896:0@lo:104: 00000100:00100000:0.0:1787836334.880673:0:6321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836334.880787:0:6321:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032deb6f2 going to sleep for 11 seconds 00000100:00100000:2.0:1787836334.881953:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193120896 00000100:00100000:2.0:1787836334.881963:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193120896 00000100:00100000:2.0:1787836334.882168:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787836334.882177:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014843e93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:6321:x1874682193120896:12345-0@lo:104: 00010000:00010000:2.0:1787836334.882192:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836334.882305:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787836334.882310:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014843e93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:6321:x1874682193120896:12345-0@lo:104: Request processed in 135us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836334.882317:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787836334.882394:0:6321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099a11d0e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1874682193120896:0@lo:104: 00010000:00010000:0.0:1787836334.882419:0:6321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.882672:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836334.882678:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.882686:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000386fab70 already unused, calling callback (00000000d52b5b57) 10000000:00010000:1.0:1787836334.882689:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.882706:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836334.882712:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836334.882730:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787836334.882807:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.882815:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836334.882844:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.882851:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000386fab70/0x966835ea68ab7217 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab721e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.882867:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836334.882869:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836334.882880:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836334.882887:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836334.882899:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9d8728f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193121024:0@lo:103: 00000100:00100000:1.0:1787836334.882938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836334.882978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193121024 00000100:00100000:1.0:1787836334.882982:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193121024 00010000:00010000:1.0:1787836334.883002:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7217 expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836334.883024:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787836334.883271:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df67b307 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:3312:x1874682193121024:12345-0@lo:103: 00010000:00010000:1.0:1787836334.883285:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836334.883289:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7217 expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883299:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7217 expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883319:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b977f84/0x966835ea68ab721e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7217 expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883332:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883339:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883352:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883359:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883364:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883382:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883388:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000342c8797 already unused, calling callback (0000000009fc7190) 00010000:00010000:1.0:1787836334.883390:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883397:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883408:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836334.883428:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836334.883545:0:6321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836334.883552:0:6321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836334.883557:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000342c8797/0x966835ea68ab725d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836334.884860:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df67b307 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:3312:x1874682193121024:12345-0@lo:103: Request processed in 1824us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836334.884882:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787836334.885709:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9d8728f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193121024:0@lo:103: 00010000:00010000:0.0:1787836335.214883:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836336.242896:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836336.367701:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193121152:0@lo:400: 00000100:00100000:1.0:1787836336.367774:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836336.367829:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836336.367835:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193121280:0@lo:400: 00000100:00100000:1.0:1787836336.367865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836336.367901:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193121152 00000100:00100000:1.0:1787836336.367910:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193121152 00000100:00100000:1.0:1787836336.367957:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787836336.367966:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000981256e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:3310:x1874682193121152:12345-0@lo:400: 00000100:00100000:1.0:1787836336.368033:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000981256e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:3310:x1874682193121152:12345-0@lo:400: Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836336.368040:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787836336.368111:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fafed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193121152:0@lo:400: 00000100:00100000:1.0:1787836336.368988:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193121280 00000100:00100000:1.0:1787836336.368996:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193121280 00000100:00100000:1.0:1787836336.369040:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836336.369047:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019fa8d51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193121280:12345-0@lo:400: 00000100:00100000:1.0:1787836336.369386:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019fa8d51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193121280:12345-0@lo:400: Request processed in 338us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836336.369393:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787836336.369437:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006b300177 x1874682193121280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836336.369462:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193121280:0@lo:400: 00010000:00010000:0.0:1787836337.262572:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836338.286413:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836339.310221:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836340.334998:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787836341.345424:0:6687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787836341.345428:0:6687:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787836341.345916:0:6687:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003840ea7c 00000020:01000004:2.0:1787836341.345932:0:6687:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787836341.345944:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787836341.345955:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000032a431e2) 00000020:00000080:2.0:1787836341.345970:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1787836341.358264:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787836341.384379:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787836341.384686:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787836341.430729:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787836341.436628:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787836341.436866:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787836341.436940:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787836341.436976:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787836341.441596:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787836341.441609:0:6687:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787836341.441620:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x966835ea68ab726b 00000020:01000004:2.0:1787836341.441627:0:6687:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787836341.441647:0:6687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787836341.441651:0:6687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787836341.441657:0:6687:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787836341.441895:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787836341.441910:0:6687:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000003caf5108) 00000020:00000080:2.0:1787836341.441921:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787836341.452163:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787836341.452339:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787836341.452346:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787836341.452642:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787836341.452648:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787836341.461169:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787836341.461183:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787836341.462609:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787836341.462820:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787836341.462825:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787836341.464769:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787836341.464780:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787836341.492705:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002aaa01a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193121408:0@lo:400: 00000100:00100000:0.0:1787836341.492787:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.492906:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193121408 00000100:00100000:3.0:1787836341.492915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193121408 00000100:00100000:3.0:1787836341.492977:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787836341.493054:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f65e4969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:3312:x1874682193121408:12345-0@lo:400: 00000100:00100000:3.0:1787836341.495359:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f65e4969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:3312:x1874682193121408:12345-0@lo:400: Request processed in 2365us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.495375:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787836341.500648:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002aaa01a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193121408:0@lo:400: 00000100:00100000:0.0:1787836341.500687:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836341.500697:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000802fc7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193121536:0@lo:400: 00000100:00100000:0.0:1787836341.500783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836341.501016:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193121536 00000100:00100000:2.0:1787836341.501025:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193121536 00000100:00100000:2.0:1787836341.501101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787836341.501110:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099a11d0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193121536:12345-0@lo:400: 00000100:00100000:2.0:1787836341.501176:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099a11d0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193121536:12345-0@lo:400: Request processed in 67us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836341.501184:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787836341.501875:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000802fc7ae x1874682193121536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836341.501892:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000802fc7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193121536:0@lo:400: 00000100:00100000:1.0:1787836341.502000:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787836341.502353:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787836341.502359:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787836341.504330:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787836341.504345:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787836341.505619:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787836341.505631:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787836341.509538:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787836341.509752:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787836341.509759:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787836341.510412:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787836341.510418:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787836341.554226:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787836341.554420:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787836341.554427:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787836341.555628:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787836341.555637:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787836341.556389:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787836341.556411:0:6687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787836341.556417:0:6687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787836341.585694:0:6687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787836341.585732:0:6687:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787836341.585736:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787836341.585738:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787836341.585739:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836341.585740:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836341.585741:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836341.585742:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836341.585744:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836341.585745:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787836341.585747:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787836341.585748:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836341.585749:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787836341.585753:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787836341.585755:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787836341.585757:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787836341.585761:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836341.585762:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836341.585763:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836341.585764:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836341.585765:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836341.585766:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787836341.585767:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787836341.585768:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836341.585769:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787836341.585797:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787836341.585816:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000802fc7ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193121664:0@lo:253: 00000100:00100000:2.0:1787836341.585883:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836341.586032:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b590132 going to sleep for 11 seconds 00000100:00100000:1.0:1787836341.586554:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193121664 00000100:00100000:1.0:1787836341.586561:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193121664 00000100:00100000:1.0:1787836341.586617:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787836341.586625:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cd1aa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193121664:12345-0@lo:253: 20000000:01000000:1.0:1787836341.586653:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787836341.586658:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787836341.586662:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787836341.586665:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787836341.588373:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787836341.588617:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787836341.588633:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787836341.588681:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787836341.588689:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787836341.588728:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787836341.588772:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787836341.589596:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787836341.589617:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:1.0:1787836341.589619:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787836341.589652:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787836341.589660:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787836341.589719:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787836341.589729:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:1.0:1787836341.589761:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787836341.589770:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787836341.589801:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787836341.589851:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787836341.591692:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787836341.591722:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:1.0:1787836341.591724:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787836341.591759:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787836341.591766:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787836341.591794:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787836341.591800:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:1.0:1787836341.591842:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787836341.591851:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787836341.591880:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787836341.596242:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787836341.596286:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787836341.596289:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787836341.596295:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787836341.596296:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787836341.596298:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787836341.596327:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787836341.596330:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787836341.596374:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787836341.596376:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787836341.598370:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787836341.598485:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787836341.598539:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787836341.600792:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787836341.600835:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787836341.600991:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787836341.601004:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787836341.601007:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787836341.601875:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1787836341.601953:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1787836341.602005:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787836341.602486:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787836341.602529:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787836341.602562:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787836341.602574:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787836341.602576:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787836341.603005:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787836341.603536:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787836341.603579:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787836341.603664:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1787836341.603686:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787836341.603706:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.603726:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7199 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.603733:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.603738:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7225 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.603745:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.603782:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7225 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.603797:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7225 expref: 11 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.604230:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097d7ac93 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1874682193121792:0@lo:104: 00000100:00100000:0.0:1787836341.604303:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787836341.604401:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.604411:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 11 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.604420:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c569eb9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1874682193121920:0@lo:104: 00000100:00100000:0.0:1787836341.604460:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787836341.607647:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7199 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.607667:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7199 expref: 11 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.607680:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1874682193122048:0@lo:104: 00000100:00100000:0.0:1787836341.607730:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836341.612181:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193121792 00000100:00100000:2.0:1787836341.612198:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193121792 00000100:00100000:0.0:1787836341.614558:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aee07a09 going to sleep for 11 seconds 00000100:00100000:3.0:1787836341.615467:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193121920 00000100:00100000:3.0:1787836341.615478:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193121920 00000100:00100000:3.0:1787836341.615528:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193122048 00000100:00100000:3.0:1787836341.615531:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193122048 00000100:00100000:3.0:1787836341.615547:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787836341.615554:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dffa3063 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:5836:x1874682193121792:12345-0@lo:104: 00010000:00010000:3.0:1787836341.615568:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.615645:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787836341.615650:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dffa3063 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:5836:x1874682193121792:12345-0@lo:104: Request processed in 98us (11348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.615657:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787836341.615673:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787836341.615678:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009741f9ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:5836:x1874682193122048:12345-0@lo:104: 00010000:00010000:3.0:1787836341.615706:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.615745:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787836341.615749:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009741f9ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:5836:x1874682193122048:12345-0@lo:104: Request processed in 72us (8020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.615755:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787836341.615788:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787836341.615792:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001187de47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5836:x1874682193121920:12345-0@lo:104: 00010000:00010000:3.0:1787836341.615798:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.615823:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787836341.615826:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001187de47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5836:x1874682193121920:12345-0@lo:104: Request processed in 35us (11367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.615832:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787836341.615878:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787836341.615883:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.615890:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7d22e19 already unused, calling callback (00000000d52b5b57) 10000000:00010000:1.0:1787836341.615893:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.615900:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836341.615917:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836341.615923:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836341.615958:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.615975:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836341.615994:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616001:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000e7d22e19/0x966835ea68ab7225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab722c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616029:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836341.616031:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616037:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eae98b9d already unused, calling callback (00000000d52b5b57) 10000000:00010000:1.0:1787836341.616039:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616045:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836341.616050:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836341.616077:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836341.616090:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616097:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836341.616100:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616105:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000eae98b9d/0x966835ea68ab7199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab71a0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616120:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836341.616122:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616126:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002aa1e7af already unused, calling callback (00000000d52b5b57) 10000000:00010000:1.0:1787836341.616128:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616134:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836341.616139:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836341.616144:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836341.616156:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616162:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836341.616176:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616183:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab71b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab71bc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616197:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836341.616199:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836341.616200:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836341.616214:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193122176:0@lo:103: 00000100:00100000:1.0:1787836341.616257:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.616290:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836341.616295:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003697670c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193122304:0@lo:103: 00000100:00100000:1.0:1787836341.616328:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.616358:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9d8728f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193122432:0@lo:103: 00000100:00100000:1.0:1787836341.616380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.616410:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193122176 00000100:00100000:1.0:1787836341.616413:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193122176 00010000:00010000:1.0:1787836341.616433:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7225 expref: 12 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836341.616458:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193122304 00000100:00100000:1.0:1787836341.616461:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193122304 00010000:00010000:1.0:1787836341.616471:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7199 expref: 13 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836341.616479:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193122432 00000100:00100000:1.0:1787836341.616481:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193122432 00010000:00010000:1.0:1787836341.616488:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 14 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836341.616498:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836341.616502:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fafed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:3310:x1874682193122176:12345-0@lo:103: 00010000:00010000:1.0:1787836341.616510:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836341.616513:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7225 expref: 14 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616522:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7225 expref: 14 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616547:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836341.616574:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fafed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:3310:x1874682193122176:12345-0@lo:103: Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.616581:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836341.616595:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836341.616601:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089d2c903 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3310:x1874682193122304:12345-0@lo:103: 00010000:00010000:1.0:1787836341.616608:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836341.616611:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7199 expref: 13 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616619:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7199 expref: 13 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616628:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836341.616646:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089d2c903 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3310:x1874682193122304:12345-0@lo:103: Request processed in 46us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.616652:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836341.616663:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836341.616668:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073cbf10a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:3312:x1874682193122432:12345-0@lo:103: 00010000:00010000:1.0:1787836341.616675:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836341.616678:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 12 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616685:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 12 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616694:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616706:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616719:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616724:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616730:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616735:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616739:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000080d352d already unused, calling callback (0000000009fc7190) 00010000:00010000:1.0:1787836341.616742:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616748:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616754:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.616763:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836341.616786:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073cbf10a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:3312:x1874682193122432:12345-0@lo:103: Request processed in 118us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.616792:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836341.616826:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9d8728f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193122432:0@lo:103: 00000100:00100000:1.0:1787836341.616856:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003697670c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193122304:0@lo:103: 00000100:00100000:1.0:1787836341.616863:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b300177 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193122176:0@lo:103: 00010000:00010000:2.0:1787836341.616984:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836341.617355:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000927da5b9/0x966835ea68ab722c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7225 expref: 11 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.617367:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097d7ac93 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1874682193121792:0@lo:104: 00010000:00010000:0.0:1787836341.617376:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000053f4841c/0x966835ea68ab71bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab71b5 expref: 10 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.617384:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c569eb9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1874682193121920:0@lo:104: 00010000:00010000:0.0:1787836341.617392:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d64b3d83/0x966835ea68ab71a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7199 expref: 9 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.617400:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1874682193122048:0@lo:104: 00010000:00010000:0.0:1787836341.617422:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.617430:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.617435:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.617458:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000080d352d/0x966835ea68ab7279 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787836341.617469:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787836341.690565:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cd1aa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+8:6687:x1874682193121664:12345-0@lo:253: Request processed in 103932us (104673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.690580:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787836341.690695:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000802fc7ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193121664:0@lo:253: 10000000:01000000:0.0:1787836341.690712:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787836341.690716:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787836341.690718:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787836341.690719:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836341.690720:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787836341.690721:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836341.690722:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836341.690724:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787836341.690725:0:6687:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787836341.690727:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836341.690728:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787836341.690748:0:6687:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003840ea7c from lustre-OST0000 10000000:01000000:0.0:1787836341.690776:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787836341.690778:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787836341.690785:0:6687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e3c7faced8 local copy 10000000:01000000:0.0:1787836341.690789:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787836341.690828:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.690840:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.690848:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.690864:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193122560:0@lo:101: 00000100:00100000:0.0:1787836341.690917:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836341.691187:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000004627c836 going to sleep for 11 seconds 00000100:00100000:3.0:1787836341.691271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193122560 00000100:00100000:3.0:1787836341.691277:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193122560 00000100:00100000:3.0:1787836341.691314:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787836341.691322:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5e9962b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+8:6687:x1874682193122560:12345-0@lo:101: 00010000:00010000:3.0:1787836341.691335:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836341.691348:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3e0da37/0x966835ea68ab7287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7280 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.691369:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3e0da37/0x966835ea68ab7287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7280 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.691379:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3e0da37/0x966835ea68ab7287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7280 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.691395:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3e0da37, rc 0) 00000100:00100000:3.0:1787836341.691438:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5e9962b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:6687:x1874682193122560:12345-0@lo:101: Request processed in 116us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.691454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787836341.691530:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193122560:0@lo:101: 00010000:00010000:0.0:1787836341.691543:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.691550:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.691651:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193122688:0@lo:501: 00000100:00100000:0.0:1787836341.691677:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836341.691698:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000004627c836 going to sleep for 11 seconds 00000100:00100000:1.0:1787836341.691752:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193122688 00000100:00100000:1.0:1787836341.691757:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193122688 00000100:00100000:1.0:1787836341.691788:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787836341.691794:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f5c21a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:6687:x1874682193122688:12345-0@lo:501: 00000100:00100000:1.0:1787836341.692046:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f5c21a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:6687:x1874682193122688:12345-0@lo:501: Request processed in 252us (368us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787836341.692053:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787836341.692262:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193122688:0@lo:501: 10000000:01000000:0.0:1787836341.692282:0:6687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787836341.692310:0:6687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787836341.692315:0:6687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.692323:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.692329:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.692352:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787836341.692374:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e3d01b2000 10000000:01000000:0.0:1787836341.692379:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787836341.692383:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98e3c7faced8 10000000:01000000:0.0:1787836341.692393:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787836341.692396:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98e3c7faced8 from 1 10000000:01000000:0.0:1787836341.692399:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787836341.692419:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 0000000053f4841c/0x966835ea68ab728e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.692426:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 0000000053f4841c/0x966835ea68ab728e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.692434:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 0000000053f4841c/0x966835ea68ab728e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.692458:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193122816:0@lo:101: 00000100:00100000:0.0:1787836341.692486:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787836341.692562:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836341.692566:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.692574:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000080d352d already unused, calling callback (00000000d52b5b57) 10000000:00010000:1.0:1787836341.692577:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.692584:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836341.692591:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836341.692597:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836341.692622:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.692629:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836341.692645:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.692651:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: 00000000080d352d/0x966835ea68ab7280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x966835ea68ab7287 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.692666:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836341.692668:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836341.692669:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836341.692678:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c46be3eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193122944:0@lo:103: 00000100:00100000:1.0:1787836341.692705:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.692909:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193122944 00000100:00100000:1.0:1787836341.692914:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193122944 00000100:00100000:1.0:1787836341.692951:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836341.692958:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2bf51d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+9:3313:x1874682193122944:12345-0@lo:103: 00010000:00010000:1.0:1787836341.692968:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787836341.693121:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193122816 00000100:00100000:3.0:1787836341.693126:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193122816 00000100:00100000:3.0:1787836341.693148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787836341.693153:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b99f2992 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193122816:12345-0@lo:101: 00010000:00010000:3.0:1787836341.693162:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836341.693174:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066412629/0x966835ea68ab7295 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab728e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.693192:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066412629/0x966835ea68ab7295 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab728e expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.693199:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066412629/0x966835ea68ab7295 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab728e expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.693207:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066412629, rc 0) 00000100:00100000:3.0:1787836341.693238:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b99f2992 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193122816:12345-0@lo:101: Request processed in 85us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.693244:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787836341.693315:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000000aeee553 going to sleep for 11 seconds 00000100:00100000:0.0:1787836341.693330:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193122816:0@lo:101: 00010000:00010000:0.0:1787836341.693341:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 0000000053f4841c/0x966835ea68ab728e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7295 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.693348:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 0000000053f4841c/0x966835ea68ab728e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7295 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836341.693365:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787836341.693381:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 0000000053f4841c/0x966835ea68ab728e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7295 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.693388:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 0000000053f4841c/0x966835ea68ab728e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7295 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836341.693394:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787836341.693404:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787836341.693409:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787836341.693411:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787836341.693425:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 00000000342c8797/0x966835ea68ab729c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.693430:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 00000000342c8797/0x966835ea68ab729c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.693436:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 00000000342c8797/0x966835ea68ab729c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.693460:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123072:0@lo:101: 00000100:00100000:0.0:1787836341.693486:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836341.693501:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000000aeee553 going to sleep for 11 seconds 00000100:00100000:3.0:1787836341.693566:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193123072 00000100:00100000:3.0:1787836341.693570:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193123072 00000100:00100000:3.0:1787836341.693599:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787836341.693604:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cbee3db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193123072:12345-0@lo:101: 00010000:00010000:3.0:1787836341.693611:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836341.693623:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091611132/0x966835ea68ab72a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab729c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.693719:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3e0da37/0x966835ea68ab7287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab7280 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.693830:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091611132/0x966835ea68ab72a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab729c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.693839:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091611132/0x966835ea68ab72a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab729c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.693845:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091611132, rc 0) 00000100:00100000:3.0:1787836341.693920:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cbee3db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193123072:12345-0@lo:101: Request processed in 316us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.693928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787836341.693972:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836341.694250:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2bf51d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:3313:x1874682193122944:12345-0@lo:103: Request processed in 1292us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.694258:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836341.694322:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123072:0@lo:101: 00010000:00010000:0.0:1787836341.694332:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 00000000342c8797/0x966835ea68ab729c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836341.694338:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 00000000342c8797/0x966835ea68ab729c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836341.694436:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123200:0@lo:501: 00000100:00100000:0.0:1787836341.694474:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836341.694501:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000000aeee553 going to sleep for 11 seconds 00000100:00100000:3.0:1787836341.694554:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193123200 00000100:00100000:3.0:1787836341.694558:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193123200 00000100:00100000:3.0:1787836341.694590:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787836341.694597:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ca21067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123200:12345-0@lo:501: 00000100:00100000:3.0:1787836341.694811:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ca21067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123200:12345-0@lo:501: Request processed in 215us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.694818:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787836341.694904:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123200:0@lo:501: 00000100:00100000:0.0:1787836341.694929:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123328:0@lo:503: 00000100:00100000:0.0:1787836341.694962:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836341.694995:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000000aeee553 going to sleep for 11 seconds 00000100:00100000:3.0:1787836341.695202:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193123328 00000100:00100000:3.0:1787836341.695207:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193123328 00000100:00100000:3.0:1787836341.695264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787836341.695271:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aef2982a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123328:12345-0@lo:503: 00000100:00100000:3.0:1787836341.695408:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aef2982a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123328:12345-0@lo:503: Request processed in 138us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.695414:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787836341.695479:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014212dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123328:0@lo:503: 00000040:00080000:1.0:1787836341.695727:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787836341.695785:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a45421e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123456:0@lo:502: 00000100:00100000:1.0:1787836341.695819:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836341.695876:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c46be3eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193122944:0@lo:103: 00000100:00100000:1.0:1787836341.699966:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d0bff9c going to sleep for 11 seconds 00000100:00100000:0.0:1787836341.700246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193123456 00000100:00100000:0.0:1787836341.700254:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193123456 00000100:00100000:0.0:1787836341.700304:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787836341.700312:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e8b38de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123456:12345-0@lo:502: 00000100:00100000:0.0:1787836341.700561:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e8b38de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123456:12345-0@lo:502: Request processed in 249us (4742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836341.700569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787836341.700682:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a45421e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123456:0@lo:502: 00000040:00080000:1.0:1787836341.700967:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787836341.701045:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787836341.701117:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787836341.701165:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787836341.701201:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787836341.701235:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787836341.701270:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a45421e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123584:0@lo:502: 00000100:00100000:1.0:1787836341.701316:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.701338:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d0bff9c going to sleep for 11 seconds 00000100:00100000:0.0:1787836341.701468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193123584 00000100:00100000:0.0:1787836341.701475:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193123584 00000100:00100000:0.0:1787836341.701501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787836341.701508:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000de15ec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123584:12345-0@lo:502: 00000100:00100000:0.0:1787836341.701653:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000de15ec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123584:12345-0@lo:502: Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836341.701660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787836341.701847:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a45421e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123584:0@lo:502: 00000040:00080000:1.0:1787836341.701932:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787836341.701943:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787836341.702561:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787836341.702572:0:6708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787836341.702579:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836341.702581:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787836341.702586:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787836341.702603:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000615b4be0) 00000020:00000080:1.0:1787836341.702629:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787836341.702634:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787836341.702714:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003840ea7c from lustre-OST0000, refs=2 00080000:01000000:1.0:1787836341.702722:0:6708:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787836341.702729:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x966835ea68ab72b1 00010000:00010000:1.0:1787836341.711454:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787836341.711776:0:6708:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787836341.713934:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787836341.714423:0:6708:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787836341.720858:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787836341.721538:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787836341.722828:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787836341.722837:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836341.722849:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836341.722851:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787836341.722855:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836341.722858:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836341.722859:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787836341.722862:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787836341.722864:0:6708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787836341.722910:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836341.722914:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836341.722915:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787836341.722918:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787836341.724523:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787836341.724559:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787836341.724580:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: 00000000342c8797/0x966835ea68ab729c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.724592:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: 00000000342c8797/0x966835ea68ab729c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836341.724600:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3d01b2000 from 1 10000000:01000000:1.0:1787836341.724603:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787836341.724638:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab72b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.724645:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab72b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.724655:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab72b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836341.724685:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a45421e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123712:0@lo:101: 00000100:00100000:1.0:1787836341.724755:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.724801:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a264192e going to sleep for 11 seconds 00000100:00100000:1.0:1787836341.725174:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193123712 00000100:00100000:1.0:1787836341.725182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193123712 00000100:00100000:1.0:1787836341.725229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787836341.725236:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d51c1e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+10:6687:x1874682193123712:12345-0@lo:101: 00010000:00010000:1.0:1787836341.725251:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836341.725273:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010526217/0x966835ea68ab72bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab72b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.725297:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010526217/0x966835ea68ab72bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.725307:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010526217/0x966835ea68ab72bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.725315:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010526217, rc 0) 00000100:00100000:1.0:1787836341.725358:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d51c1e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193123712:12345-0@lo:101: Request processed in 122us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.725364:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787836341.725411:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a45421e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123712:0@lo:101: 00010000:00010000:1.0:1787836341.725424:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab72b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.725432:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: 000000002aa1e7af/0x966835ea68ab72b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836341.725536:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a45421e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123840:0@lo:501: 00000100:00100000:1.0:1787836341.725561:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.725589:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a264192e going to sleep for 11 seconds 00000100:00100000:3.0:1787836341.725761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193123840 00000100:00100000:3.0:1787836341.725765:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193123840 00000100:00100000:3.0:1787836341.725797:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787836341.725803:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f3b8257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193123840:12345-0@lo:501: 00000100:00100000:3.0:1787836341.726163:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f3b8257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193123840:12345-0@lo:501: Request processed in 359us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836341.726171:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787836341.726208:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a45421e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123840:0@lo:501: 00000100:00100000:3.0:1787836341.726239:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c492b4bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123968:0@lo:503: 00000100:00100000:3.0:1787836341.726962:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.727193:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193123968 00000100:00100000:1.0:1787836341.727201:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193123968 00000100:00100000:1.0:1787836341.727240:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787836341.727247:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000bde755 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193123968:12345-0@lo:503: 00000100:00100000:1.0:1787836341.727545:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000bde755 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193123968:12345-0@lo:503: Request processed in 299us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.727562:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787836341.727677:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfbefd87 going to sleep for 11 seconds 00000100:00100000:3.0:1787836341.727694:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c492b4bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193123968:0@lo:503: 00000040:00080000:3.0:1787836341.727962:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787836341.731670:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c492b4bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124096:0@lo:502: 00000100:00100000:3.0:1787836341.731764:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.731825:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfbefd87 going to sleep for 11 seconds 00000100:00100000:1.0:1787836341.732128:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193124096 00000100:00100000:1.0:1787836341.732140:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193124096 00000100:00100000:1.0:1787836341.732199:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787836341.732208:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006233a499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193124096:12345-0@lo:502: 00000100:00100000:1.0:1787836341.732493:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006233a499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193124096:12345-0@lo:502: Request processed in 286us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.732501:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787836341.732622:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c492b4bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124096:0@lo:502: 00000040:00080000:3.0:1787836341.732916:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787836341.732973:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787836341.735650:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c492b4bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124224:0@lo:502: 00000100:00100000:3.0:1787836341.735739:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.735787:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfbefd87 going to sleep for 11 seconds 00000100:00100000:1.0:1787836341.735803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193124224 00000100:00100000:1.0:1787836341.735811:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193124224 00000100:00100000:1.0:1787836341.735864:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787836341.735871:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ea5849e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193124224:12345-0@lo:502: 00000100:00100000:1.0:1787836341.736173:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ea5849e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193124224:12345-0@lo:502: Request processed in 301us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.736181:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787836341.736337:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c492b4bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124224:0@lo:502: 00000040:00080000:0.0:1787836341.736492:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787836341.736506:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787836341.736959:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836341.736977:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836341.736980:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787836341.736986:0:6712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e3d01b2000 00000020:00000080:3.0:1787836341.736989:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787836341.740605:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836341.740618:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836341.740621:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787836341.740626:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787836341.740796:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787836341.740821:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787836341.740883:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.740897:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836341.740943:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787836341.740946:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e3d01b2000 10000000:01000000:3.0:1787836341.740949:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e3d01b2000 10000000:01000000:3.0:1787836341.740953:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787836341.740958:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3d01b2000 from 1 10000000:01000000:3.0:1787836341.740961:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787836341.741000:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.741010:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.741164:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836341.741203:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124352:0@lo:101: 00000100:00100000:3.0:1787836341.741278:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.741323:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651000 going to sleep for 11 seconds 00000100:00100000:2.0:1787836341.741369:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193124352 00000100:00100000:2.0:1787836341.741376:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193124352 00000100:00100000:2.0:1787836341.741419:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787836341.741426:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193124352:12345-0@lo:101: 00010000:00010000:2.0:1787836341.741438:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836341.741461:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab72c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836341.741484:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836341.741494:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836341.741510:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e40216d000, rc 0) 00000100:00100000:2.0:1787836341.741560:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124352:12345-0@lo:101: Request processed in 134us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836341.741566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787836341.743259:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124352:0@lo:101: 00010000:00010000:3.0:1787836341.743287:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.743299:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836341.743416:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124480:0@lo:501: 00000100:00100000:3.0:1787836341.743480:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.743525:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651000 going to sleep for 11 seconds 00000100:00100000:2.0:1787836341.743573:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193124480 00000100:00100000:2.0:1787836341.743579:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193124480 00000100:00100000:2.0:1787836341.743624:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787836341.743633:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124480:12345-0@lo:501: 00000100:00100000:2.0:1787836341.743880:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124480:12345-0@lo:501: Request processed in 248us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836341.743888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787836341.743961:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124480:0@lo:501: 00000100:00100000:3.0:1787836341.743987:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124608:0@lo:503: 00000100:00100000:3.0:1787836341.744182:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.744237:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651000 going to sleep for 11 seconds 00000100:00100000:2.0:1787836341.747258:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193124608 00000100:00100000:2.0:1787836341.747271:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193124608 00000100:00100000:2.0:1787836341.747332:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787836341.747341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124608:12345-0@lo:503: 00000100:00100000:2.0:1787836341.747573:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124608:12345-0@lo:503: Request processed in 233us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836341.747581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787836341.748237:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124608:0@lo:503: 00000040:00080000:2.0:1787836341.748519:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787836341.748605:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124736:0@lo:502: 00000100:00100000:2.0:1787836341.748653:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836341.748692:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ef7d39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836341.748738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193124736 00000100:00100000:0.0:1787836341.748742:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193124736 00000100:00100000:0.0:1787836341.748826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787836341.748835:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124736:12345-0@lo:502: 00000100:00100000:0.0:1787836341.749026:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124736:12345-0@lo:502: Request processed in 183us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836341.749033:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787836341.750308:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124736:0@lo:502: 00000040:00080000:2.0:1787836341.750620:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787836341.750684:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787836341.750735:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787836341.750782:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787836341.750815:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787836341.750859:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787836341.750896:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787836341.750930:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787836341.750979:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787836341.754375:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787836341.754511:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787836341.754585:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787836341.754623:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787836341.754654:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787836341.754697:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787836341.754732:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787836341.754765:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787836341.754811:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787836341.754860:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787836341.754892:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787836341.754958:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787836341.754999:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787836341.755047:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787836341.756505:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787836341.756553:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787836341.756586:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787836341.756632:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787836341.756666:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787836341.756713:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124864:0@lo:502: 00000100:00100000:3.0:1787836341.756795:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.756879:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651780 going to sleep for 11 seconds 00000100:00100000:0.0:1787836341.760381:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193124864 00000100:00100000:0.0:1787836341.760400:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193124864 00000100:00100000:0.0:1787836341.760483:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787836341.760506:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124864:12345-0@lo:502: 00000100:00100000:0.0:1787836341.760804:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193124864:12345-0@lo:502: Request processed in 300us (4008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836341.760812:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787836341.760945:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193124864:0@lo:502: 00000040:00080000:1.0:1787836341.761105:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787836341.761124:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787836341.762574:0:6713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787836341.762606:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98e3f5800000) 00000020:00000080:1.0:1787836341.762628:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787836341.762719:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e3d01b2000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787836341.762724:0:6713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e3d01b2000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787836341.762727:0:6713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e3d01b2000 3 00010000:00080000:1.0:1787836341.762755:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e3ffdbb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1787836341.764416:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787836341.764657:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787836341.764697:0:6713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787836341.764709:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x966835ea68ab72db 00000100:00080000:1.0:1787836341.764719:0:6713:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787836341.764725:0:6713:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98e3ffdbb000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1787836341.764761:0:6713:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c198c000 x1874682193124992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787836341.764787:0:6713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787836341.764862:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193125120:0@lo:400: 00000100:00100000:1.0:1787836341.764932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.764998:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193125120 00000100:00100000:1.0:1787836341.765005:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193125120 00000100:00100000:1.0:1787836341.765079:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836341.765088:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193125120:12345-0@lo:400: 00000100:00100000:1.0:1787836341.765139:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193125120:12345-0@lo:400: Request processed in 52us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.765147:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787836341.765184:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e2c198f480 x1874682193125120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836341.765197:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193125120:0@lo:400: 00000100:00100000:3.0:1787836341.765382:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874682193124992:0@lo:38: 00000100:00100000:3.0:1787836341.765417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.770513:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193124992 00000100:00100000:1.0:1787836341.770531:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193124992 00000100:00100000:1.0:1787836341.770596:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836341.770603:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874682193124992:12345-0@lo:38: 00010000:00080000:1.0:1787836341.770633:0:5843:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1787836341.771050:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x966835ea68ab72e2 00000004:00100000:1.0:1787836341.771093:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787836341.771144:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836341.771239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874682193124992:12345-0@lo:38: Request processed in 634us (5819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.771247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1787836341.771409:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1787836341.771536:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e2c198c000 x1874682193124992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787836351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836341.771547:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787836341.771555:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787836341.771562:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787836341.771566:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787836341.771569:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdbb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787836341.771574:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874682193124992:0@lo:38: 00000020:01000000:3.0:1787836341.778172:0:6687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787836341.778206:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787836341.778225:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.778238:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787836341.778291:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787836341.778293:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787836341.778295:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836341.778296:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836341.778297:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836341.778299:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836341.778300:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787836341.778301:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787836341.778303:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787836341.778311:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836341.778312:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787836341.778316:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787836341.778318:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787836341.778319:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787836341.778320:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836341.778321:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836341.778322:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836341.778323:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836341.778324:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787836341.778325:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787836341.778326:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787836341.778327:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836341.778328:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787836341.778352:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787836341.778368:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193125248:0@lo:253: 00000100:00100000:3.0:1787836341.778432:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.778544:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e96510c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836341.780617:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193125248 00000100:00100000:2.0:1787836341.780626:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193125248 00000100:00100000:2.0:1787836341.780700:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787836341.780709:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6687:x1874682193125248:12345-0@lo:253: 20000000:01000000:2.0:1787836341.780737:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787836341.780749:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787836341.814705:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787836341.814723:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787836341.814778:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787836341.814782:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787836341.814803:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.814820:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c0031600/0x966835ea68ab7256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab724f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.814827:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.814861:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c0031600/0x966835ea68ab7256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab724f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.814873:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c0031600/0x966835ea68ab7256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab724f expref: 12 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836341.814904:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874682193125376:0@lo:104: 00000100:00100000:3.0:1787836341.814962:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836341.815105:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651840 going to sleep for 11 seconds 00000100:00100000:1.0:1787836341.815218:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193125376 00000100:00100000:1.0:1787836341.815225:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193125376 00000100:00100000:1.0:1787836341.815280:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836341.815288:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5857:x1874682193125376:12345-0@lo:104: 00010000:00010000:1.0:1787836341.815301:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815354:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787836341.815360:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5857:x1874682193125376:12345-0@lo:104: Request processed in 73us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.815366:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787836341.815389:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836341.815395:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815402:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e40216c600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836341.815406:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab724f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815414:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab724f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836341.815421:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab724f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836341.815434:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836341.815474:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab724f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815480:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836341.815495:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab724f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815502:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab724f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7256 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815519:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836341.815520:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836341.815522:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836341.815541:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193125504:0@lo:103: 00000100:00100000:1.0:1787836341.815570:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836341.815603:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193125504 00000100:00100000:1.0:1787836341.815607:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193125504 00010000:00010000:1.0:1787836341.815622:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c0031600/0x966835ea68ab7256 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab724f expref: 13 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836341.815642:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836341.815649:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8601850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3311:x1874682193125504:12345-0@lo:103: 00010000:00010000:1.0:1787836341.815659:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836341.815663:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c0031600/0x966835ea68ab7256 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab724f expref: 13 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815673:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c0031600/0x966835ea68ab7256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab724f expref: 13 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815695:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815702:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787836341.815714:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004990709s 00010000:00010000:1.0:1787836341.815718:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815724:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815730:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815737:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815742:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152ac00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836341.815748:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815755:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815762:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836341.815770:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836341.815797:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8601850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3311:x1874682193125504:12345-0@lo:103: Request processed in 149us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.815811:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836341.815863:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193125504:0@lo:103: 00010000:00010000:3.0:1787836341.816144:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031600/0x966835ea68ab7256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab724f expref: 12 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836341.816155:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874682193125376:0@lo:104: 00010000:00010000:3.0:1787836341.816168:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.816177:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.816183:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836341.816189:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c152ac00/0x966835ea68ab72e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836341.823273:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:6687:x1874682193125248:12345-0@lo:253: Request processed in 42555us (44830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836341.823287:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787836341.823383:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:6687:1874682193125248:0@lo:253: 10000000:01000000:3.0:1787836341.823399:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787836341.823402:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787836341.823403:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787836341.823405:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836341.823406:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836341.823407:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836341.823408:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836341.823410:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787836341.823411:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787836341.823413:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787836341.823427:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836341.823428:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787836341.823453:0:6687:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787836341.828311:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787836341.828499:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787836341.828686:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787836341.828850:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787836341.829185:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787836341.829419:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787836341.833090:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787836342.151347:0:6687:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787836342.151355:0:6687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787836342.151388:0:6687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787836342.151458:0:6687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787836342.151473:0:6687:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787836342.151491:0:6687:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787836342.382227:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787836342.447790:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787836342.447797:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3ce1d0800 from 21 10000000:01000000:0.0:1787836342.447802:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787836342.447852:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836342.447866:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836342.447880:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836342.447911:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193125632:0@lo:101: 00000100:00100000:0.0:1787836342.448009:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836342.448094:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3fabcd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836342.448124:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193125632 00000100:00100000:0.0:1787836342.448134:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193125632 00000100:00100000:0.0:1787836342.448196:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787836342.448206:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:5839:x1874682193125632:12345-0@lo:101: 00010000:00010000:0.0:1787836342.448230:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836342.448244:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab72f0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836342.448270:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836342.448282:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836342.448290:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030800, rc 0) 00000100:00100000:0.0:1787836342.448330:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193125632:12345-0@lo:101: Request processed in 126us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836342.448337:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787836342.448392:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193125632:0@lo:101: 00010000:00010000:0.0:1787836342.448408:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836342.448416:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836342.448481:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193125760:0@lo:501: 00000100:00100000:0.0:1787836342.448508:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836342.448526:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3fabcd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836342.448538:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193125760 00000100:00100000:0.0:1787836342.448542:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193125760 00000100:00100000:0.0:1787836342.448565:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787836342.448571:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193125760:12345-0@lo:501: 00000100:00100000:0.0:1787836342.448804:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193125760:12345-0@lo:501: Request processed in 232us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836342.448811:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787836342.448843:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193125760:0@lo:501: 00000100:00100000:0.0:1787836342.448870:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193125888:0@lo:503: 00000100:00100000:0.0:1787836342.448904:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836342.448916:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3fabcd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836342.448927:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193125888 00000100:00100000:0.0:1787836342.448930:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193125888 00000100:00100000:0.0:1787836342.448949:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787836342.448954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193125888:12345-0@lo:503: 00000100:00100000:0.0:1787836342.449121:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193125888:12345-0@lo:503: Request processed in 165us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836342.449127:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787836342.449165:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193125888:0@lo:503: 00000100:00100000:2.0:1787836342.449866:0:6731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6731:1874682193126016:0@lo:502: 00000100:00100000:2.0:1787836342.449919:0:6731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.449949:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193126016 00000100:00100000:2.0:1787836342.449954:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193126016 00000100:00100000:2.0:1787836342.449997:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787836342.450005:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6731:x1874682193126016:12345-0@lo:502: 00000100:00100000:2.0:1787836342.450210:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6731:x1874682193126016:12345-0@lo:502: Request processed in 205us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.450217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787836342.450264:0:6731:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.450281:0:6731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6731:1874682193126016:0@lo:502: 00000100:00100000:2.0:1787836342.450325:0:6731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6731:1874682193126144:0@lo:502: 00000100:00100000:2.0:1787836342.450356:0:6731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.450373:0:6731:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154180 going to sleep for 11 seconds 00000100:00100000:0.0:1787836342.451432:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193126144 00000100:00100000:0.0:1787836342.451450:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193126144 00000100:00100000:0.0:1787836342.451490:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787836342.451498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6731:x1874682193126144:12345-0@lo:502: 00000100:00100000:0.0:1787836342.451716:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:6731:x1874682193126144:12345-0@lo:502: Request processed in 218us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836342.451722:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787836342.452110:0:6731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6731:1874682193126144:0@lo:502: 00000040:00080000:3.0:1787836342.452147:0:6731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787836342.453261:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787836342.453290:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787836342.453302:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.453315:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836342.453324:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787836342.453327:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e3ce1d0800 from 4 10000000:01000000:2.0:1787836342.453329:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787836342.453369:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.453377:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.453387:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836342.453409:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126272:0@lo:101: 00000100:00100000:2.0:1787836342.453495:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.453531:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.453548:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193126272 00000100:00100000:2.0:1787836342.453553:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193126272 00000100:00100000:2.0:1787836342.453590:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787836342.453597:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193126272:12345-0@lo:101: 00010000:00010000:2.0:1787836342.453608:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836342.453621:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab72fe expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.453640:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab72fe expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.453650:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab72fe expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.453659:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e40216d400, rc 0) 00000100:00100000:2.0:1787836342.453691:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193126272:12345-0@lo:101: Request processed in 94us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.453698:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787836342.453735:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126272:0@lo:101: 00010000:00010000:2.0:1787836342.453747:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.453755:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836342.453799:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126400:0@lo:256: 00000100:00100000:2.0:1787836342.453830:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.453841:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.453853:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193126400 00000100:00100000:2.0:1787836342.453857:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193126400 00000100:00100000:2.0:1787836342.453879:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787836342.453885:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193126400:12345-0@lo:256: 20000000:01000000:2.0:1787836342.453900:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787836342.453917:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787836342.453920:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787836342.457697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193126400:12345-0@lo:256: Request processed in 3798us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.457715:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787836342.457813:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126400:0@lo:256: 10000000:01000000:2.0:1787836342.457878:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787836342.457889:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.457901:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836342.457912:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787836342.457916:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787836342.457919:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787836342.457959:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.457967:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.458309:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836342.458330:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126528:0@lo:101: 00000100:00100000:2.0:1787836342.458372:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.458415:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.458435:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193126528 00000100:00100000:2.0:1787836342.458451:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193126528 00000100:00100000:2.0:1787836342.458493:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787836342.458501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193126528:12345-0@lo:101: 00010000:00010000:2.0:1787836342.458516:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836342.458529:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab730c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.458555:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab730c expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.458566:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab730c expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.458575:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e40216cc00, rc 0) 00000100:00100000:2.0:1787836342.458609:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193126528:12345-0@lo:101: Request processed in 109us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.458615:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787836342.458651:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126528:0@lo:101: 00010000:00010000:2.0:1787836342.458663:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.458682:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836342.458731:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126656:0@lo:501: 00000100:00100000:2.0:1787836342.458756:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.458770:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.458781:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193126656 00000100:00100000:2.0:1787836342.458784:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193126656 00000100:00100000:2.0:1787836342.458805:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787836342.458811:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193126656:12345-0@lo:501: 00000100:00100000:2.0:1787836342.461301:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193126656:12345-0@lo:501: Request processed in 2478us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.461314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787836342.462761:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126656:0@lo:501: 00000100:00100000:0.0:1787836342.462826:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126784:0@lo:503: 00000100:00100000:0.0:1787836342.462909:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836342.462946:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3fabcd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.463242:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193126784 00000100:00100000:2.0:1787836342.463251:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193126784 00000100:00100000:2.0:1787836342.463303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787836342.463312:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193126784:12345-0@lo:503: 00000100:00100000:2.0:1787836342.463572:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193126784:12345-0@lo:503: Request processed in 260us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.463580:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787836342.463631:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193126784:0@lo:503: 00000100:00100000:2.0:1787836342.463827:0:6732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6732:1874682193126912:0@lo:502: 00000100:00100000:2.0:1787836342.463863:0:6732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.463886:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193126912 00000100:00100000:2.0:1787836342.463890:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193126912 00000100:00100000:2.0:1787836342.463919:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787836342.463924:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:6732:x1874682193126912:12345-0@lo:502: 00000100:00100000:0.0:1787836342.465207:0:6732:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.465626:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:6732:x1874682193126912:12345-0@lo:502: Request processed in 1697us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.465638:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787836342.466124:0:6732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6732:1874682193126912:0@lo:502: 00000020:01000000:0.0:1787836342.466165:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787836342.466175:0:6732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787836342.466183:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836342.466185:0:6732:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787836342.466196:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787836342.466201:0:6732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:0.0:1787836342.466228:0:6732:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787836342.466231:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787836342.466260:0:6732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98e3d83e9a48) 00000020:00000080:0.0:1787836342.466284:0:6732:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787836342.466290:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787836342.466406:0:6732:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787836342.466414:0:6732:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787836342.466421:0:6732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab7321 00010000:00080000:0.0:1787836342.466474:0:6732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e3ef7e3000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1787836342.466697:0:6732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787836342.550187:0:6732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787836342.552107:0:6732:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787836342.553024:0:6732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787836342.553283:0:6732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787836342.553331:0:6732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787836342.553392:0:6732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787836342.555786:0:6736:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787836342.555793:0:6736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787836342.556480:0:6732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787836342.556492:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787836342.556540:0:6732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787836342.556561:0:6732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab7328 00000100:00080000:2.0:1787836342.556574:0:6732:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787836342.556580:0:6732:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98e3ef7e3000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1787836342.556615:0:6732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3d3dde940 x1874682193127040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787836342.556642:0:6732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787836342.556696:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836342.556700:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836342.556702:0:6732:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787836342.556705:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787836342.556708:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836342.556710:0:6732:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787836342.556712:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787836342.556714:0:6732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787836342.556740:0:6732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6732:1874682193127168:0@lo:502: 00000100:00100000:2.0:1787836342.556814:0:6732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836342.556986:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193127040:0@lo:8: 00000100:00100000:3.0:1787836342.559818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836342.560022:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193127040 00000100:00100000:1.0:1787836342.560033:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193127040 00000100:00100000:1.0:1787836342.560092:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836342.560102:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874682193127040:12345-0@lo:8: 00010000:00080000:1.0:1787836342.560134:0:6691:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1787836342.560169:0:6691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab732f 00002000:00100000:1.0:1787836342.560226:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98e3ffdbe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113961 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787836342.560231:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787836342.560236:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787836342.560374:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787836342.560587:0:6691:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787836342.560619:0:6691:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdbd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836342.560691:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874682193127040:12345-0@lo:8: Request processed in 589us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836342.560698:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787836342.560763:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3dde940 x1874682193127040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787836352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836342.560774:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787836342.560782:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787836342.560791:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787836342.560796:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787836342.560799:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7e3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787836342.560808:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787836342.560814:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193127040:0@lo:8: 00000100:00100000:2.0:1787836342.563734:0:6732:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c543b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.563780:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193127168 00000100:00100000:2.0:1787836342.563790:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193127168 00000100:00100000:2.0:1787836342.563841:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787836342.563850:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:6732:x1874682193127168:12345-0@lo:502: 00000004:00080000:1.0:1787836342.566261:0:6736:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787836342.566377:0:6736:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190999318066ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787836342.567490:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:6732:x1874682193127168:12345-0@lo:502: Request processed in 3634us (10670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.567503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787836342.567675:0:6732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6732:1874682193127168:0@lo:502: 00000020:01000000:2.0:1787836342.567709:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836342.567716:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836342.567719:0:6732:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787836342.567724:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787836342.573145:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787836342.573178:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787836342.573190:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.573205:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836342.573216:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787836342.573219:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3ce1d0800 from 1 10000000:01000000:2.0:1787836342.573222:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787836342.573257:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.573265:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.573276:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836342.573310:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193127296:0@lo:101: 00000100:00100000:2.0:1787836342.573372:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.573410:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c543b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.573566:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193127296 00000100:00100000:2.0:1787836342.573574:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193127296 00000100:00100000:2.0:1787836342.573621:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787836342.573630:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193127296:12345-0@lo:101: 00010000:00010000:2.0:1787836342.573646:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836342.573661:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7336 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.573687:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7336 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.573699:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7336 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.573708:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e40216c400, rc 0) 00000100:00100000:2.0:1787836342.573748:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193127296:12345-0@lo:101: Request processed in 118us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.573756:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787836342.573806:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193127296:0@lo:101: 00010000:00010000:2.0:1787836342.573820:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.573830:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836342.573895:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193127424:0@lo:501: 00000100:00100000:2.0:1787836342.573922:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.573937:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c543b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.573950:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193127424 00000100:00100000:2.0:1787836342.573953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193127424 00000100:00100000:2.0:1787836342.573975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787836342.574409:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193127424:12345-0@lo:501: 00000100:00100000:2.0:1787836342.575456:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193127424:12345-0@lo:501: Request processed in 1045us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.575467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787836342.577133:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193127424:0@lo:501: 00000100:00100000:3.0:1787836342.577218:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193127552:0@lo:503: 00000100:00100000:3.0:1787836342.577297:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836342.577344:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.579593:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193127552 00000100:00100000:2.0:1787836342.579607:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193127552 00000100:00100000:2.0:1787836342.579657:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787836342.579667:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193127552:12345-0@lo:503: 00000100:00100000:2.0:1787836342.580181:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193127552:12345-0@lo:503: Request processed in 513us (2881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.580190:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787836342.580263:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193127552:0@lo:503: 00000100:00100000:3.0:1787836342.590278:0:6739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6739:1874682193127680:0@lo:502: 00000100:00100000:3.0:1787836342.590367:0:6739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836342.590423:0:6739:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c34299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.593024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193127680 00000100:00100000:2.0:1787836342.593042:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193127680 00000100:00100000:2.0:1787836342.593105:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787836342.593115:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:6739:x1874682193127680:12345-0@lo:502: 00000100:00100000:2.0:1787836342.603835:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:6739:x1874682193127680:12345-0@lo:502: Request processed in 10712us (13458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.603850:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787836342.608085:0:6739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6739:1874682193127680:0@lo:502: 00000020:01000000:3.0:1787836342.608140:0:6739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836342.608151:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836342.608153:0:6739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787836342.608160:0:6739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e3ce1d0800 00000020:00000080:3.0:1787836342.608163:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787836342.608203:0:6739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6739:1874682193127808:0@lo:502: 00000100:00100000:3.0:1787836342.608273:0:6739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836342.608321:0:6739:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c34299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.610227:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193127808 00000100:00100000:2.0:1787836342.610239:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193127808 00000100:00100000:2.0:1787836342.610294:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787836342.610304:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:6739:x1874682193127808:12345-0@lo:502: 00000100:00100000:2.0:1787836342.610611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:6739:x1874682193127808:12345-0@lo:502: Request processed in 308us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.610619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787836342.612177:0:6739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:6739:1874682193127808:0@lo:502: 00000020:01000000:3.0:1787836342.612237:0:6739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836342.612258:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836342.612261:0:6739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787836342.612266:0:6739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787836342.617716:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787836342.617754:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787836342.617766:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.617779:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836342.618093:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787836342.618097:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e3c7faced8 from 1 10000000:01000000:3.0:1787836342.618100:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787836342.618140:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836342.618149:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836342.618161:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836342.618185:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b69680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193127936:0@lo:101: 00000100:00100000:3.0:1787836342.618247:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836342.618283:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c34299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.618341:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193127936 00000100:00100000:2.0:1787836342.618346:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193127936 00000100:00100000:2.0:1787836342.618390:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787836342.618400:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193127936:12345-0@lo:101: 00010000:00010000:2.0:1787836342.618411:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836342.618422:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7344 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.618453:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7344 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.618465:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7344 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.618474:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e40216c800, rc 0) 00000100:00100000:2.0:1787836342.618522:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193127936:12345-0@lo:101: Request processed in 123us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836342.618529:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787836342.618569:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b69680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193127936:0@lo:101: 00010000:00010000:2.0:1787836342.618583:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836342.618592:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836342.618636:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193128064:0@lo:501: 00000100:00100000:2.0:1787836342.618657:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.618671:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.618682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193128064 00000100:00100000:2.0:1787836342.618685:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193128064 00000100:00100000:2.0:1787836342.618702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787836342.618707:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193128064:12345-0@lo:501: 00000100:00100000:2.0:1787836342.620093:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193128064:12345-0@lo:501: Request processed in 1378us (1426us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787836342.620104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787836342.630000:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193128064:0@lo:501: 10000000:01000000:3.0:1787836342.630149:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787836342.630159:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836342.630172:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836342.647462:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787836342.648282:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193128192:0@lo:13: 00000100:00100000:1.0:1787836342.648344:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836342.648445:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193128192 00000100:00100000:0.0:1787836342.648452:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193128192 00000100:00100000:0.0:1787836342.648499:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836342.648507:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193128192:12345-0@lo:13: 00002000:00000024:0.0:1787836342.648537:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000004:00080000:2.0:1787836342.648601:0:6738:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787836342.648623:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1874682193128320:0@lo:7: 00000100:00100000:2.0:1787836342.648653:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.648674:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836342.648739:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193128320 00000100:00100000:3.0:1787836342.648743:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193128320 00000100:00100000:3.0:1787836342.648770:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836342.648777:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6738:x1874682193128320:12345-0@lo:7: 00000100:00100000:0.0:1787836342.652648:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874682193128192:12345-0@lo:13: Request processed in 4134us (4295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836342.652662:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787836342.652699:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787836342.652952:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3dded00 x1874682193128192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836342.652977:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193128192:0@lo:13: 00002000:00080000:3.0:1787836342.654016:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787836342.654022:0:6693:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787836342.654340:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6738:x1874682193128320:12345-0@lo:7: Request processed in 5561us (5682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836342.654351:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787836342.655313:0:6738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3ddf840 x1874682193128320/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787836358 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836342.655328:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1874682193128320:0@lo:7: 00000004:00080000:2.0:1787836342.655350:0:6738:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787836342.655402:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1874682193128448:0@lo:5: 00000100:00100000:2.0:1787836342.655454:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.655498:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836342.655558:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193128448 00000100:00100000:3.0:1787836342.655565:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193128448 00000100:00100000:3.0:1787836342.655612:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787836342.655621:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6738:x1874682193128448:12345-0@lo:5: 00002000:00080000:3.0:1787836342.655646:0:6692:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787836342.655649:0:6692:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787836342.655948:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6738:x1874682193128448:12345-0@lo:5: Request processed in 327us (493us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787836342.655954:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787836342.664960:0:6738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3ddf840 x1874682193128448/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787836358 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836342.664993:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1874682193128448:0@lo:5: 00000004:00080000:2.0:1787836342.665009:0:6738:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787836342.665236:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1874682193128576:0@lo:700: 00000100:00100000:2.0:1787836342.665297:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.665348:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787836342.665403:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193128576 00000100:00100000:1.0:1787836342.665411:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193128576 00000100:00100000:1.0:1787836342.665469:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836342.665478:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6738:x1874682193128576:12345-0@lo:700: 00000100:00100000:1.0:1787836342.665512:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1874682193128704:0@lo:700: 00000100:00100000:1.0:1787836342.665563:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836342.665593:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1bb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787836342.665662:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193128704 00000100:00100000:2.0:1787836342.665666:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193128704 00000100:00100000:2.0:1787836342.665711:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787836342.665718:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1874682193128704:12345-0@lo:700: 00000100:00080000:0.0:1787836342.666080:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:2.0:1787836342.711537:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787836342.717820:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1874682193128704:12345-0@lo:700: Request processed in 52094us (52248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836342.717839:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787836342.718248:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198f0c0 x1874682193128704/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787836358 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836342.718264:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1874682193128704:0@lo:700: 40000000:02000000:2.0:1787836342.718278:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1787836342.810984:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787836342.811005:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787836342.812085:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6738:x1874682193128576:12345-0@lo:700: Request processed in 146601us (146780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836342.812107:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787836342.812214:0:6738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3ddc000 x1874682193128576/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787836358 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836342.812225:0:6738:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787836342.812242:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1874682193128576:0@lo:700: 00000004:02000040:3.0:1787836342.838272:0:6738:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787836342.847404:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1874682193128832:0@lo:5: 00000100:00100000:2.0:1787836342.847480:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836342.847532:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e567d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787836342.850811:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193128832 00000100:00100000:3.0:1787836342.850825:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193128832 00000100:00100000:3.0:1787836342.850894:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787836342.850905:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6738:x1874682193128832:12345-0@lo:5: 00002000:00080000:3.0:1787836342.856426:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787836342.856458:0:6693:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787836342.859325:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6738:x1874682193128832:12345-0@lo:5: Request processed in 8412us (11835us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787836342.859339:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787836342.859469:0:6738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3ddc000 x1874682193128832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787836358 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836342.859487:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1874682193128832:0@lo:5: 00000004:00080000:1.0:1787836342.859503:0:6738:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787836343.406194:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836344.433692:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836345.454959:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836346.480533:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836347.512442:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836347.637711:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193128960:0@lo:400: 00000100:00100000:1.0:1787836347.637787:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836347.637840:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836347.637846:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193129344:0@lo:400: 00000100:00100000:1.0:1787836347.637872:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836347.637909:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193129088:0@lo:400: 00000100:00100000:1.0:1787836347.637935:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836347.637953:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836347.637959:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193129216:0@lo:400: 00000100:00100000:1.0:1787836347.637980:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836347.638015:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193128960 00000100:00100000:1.0:1787836347.638023:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193128960 00000100:00100000:1.0:1787836347.638087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787836347.638096:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3313:x1874682193128960:12345-0@lo:400: 00000100:00100000:1.0:1787836347.638146:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3313:x1874682193128960:12345-0@lo:400: Request processed in 51us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836347.638153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787836347.638189:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193129344 00000100:00100000:1.0:1787836347.638210:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193129344 00000100:00100000:1.0:1787836347.638257:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836347.638265:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193129344:12345-0@lo:400: 00000100:00100000:1.0:1787836347.638297:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193129344:12345-0@lo:400: Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836347.638303:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836347.638323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193129088 00000100:00100000:1.0:1787836347.638327:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193129088 00000100:00100000:1.0:1787836347.638350:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193129216 00000100:00100000:1.0:1787836347.638352:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193129216 00000100:00100000:1.0:1787836347.638370:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836347.638376:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193129088:12345-0@lo:400: 00000100:00100000:1.0:1787836347.642700:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193129088:12345-0@lo:400: Request processed in 4312us (4751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836347.642714:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836347.642753:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836347.642770:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193129216:12345-0@lo:400: 00000100:00100000:1.0:1787836347.642839:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193129216:12345-0@lo:400: Request processed in 78us (4858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836347.642845:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787836347.642926:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198ed00 x1874682193129344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836347.642942:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193129344:0@lo:400: 00000100:00100000:1.0:1787836347.642955:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193128960:0@lo:400: 00010000:00080000:2.0:1787836347.643088:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198d2c0 x1874682193129216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836347.643100:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193129216:0@lo:400: 00010000:00080000:2.0:1787836347.643118:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198e940 x1874682193129088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836347.643127:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193129088:0@lo:400: 00000100:00080000:1.0:1787836347.643257:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787836347.643262:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836348.142559:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193129472:0@lo:13: 00000100:00100000:1.0:1787836348.142654:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836348.142736:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193129472 00000100:00100000:1.0:1787836348.142743:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193129472 00000100:00100000:1.0:1787836348.142785:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787836348.142794:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193129472:12345-0@lo:13: 00002000:00000024:1.0:1787836348.142827:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836348.142872:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193129472:12345-0@lo:13: Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836348.142880:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787836348.142937:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3ddda40 x1874682193129472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836348.142956:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193129472:0@lo:13: 00000001:00080000:3.0:1787836348.239950:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787836348.529638:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787836348.987347:0:7063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787836349.551577:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836350.581967:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836351.599556:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836352.659315:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836352.762598:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193129856:0@lo:400: 00000100:00100000:0.0:1787836352.762734:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193129728:0@lo:400: 00000100:00100000:0.0:1787836352.762811:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836352.762872:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787836352.762879:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193129600:0@lo:400: 00000100:00100000:3.0:1787836352.763142:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836352.763181:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787836352.763187:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193129984:0@lo:400: 00000100:00100000:3.0:1787836352.763213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836352.763251:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193129984 00000100:00100000:3.0:1787836352.763264:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193129984 00000100:00100000:3.0:1787836352.763342:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836352.763352:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193129984:12345-0@lo:400: 00000100:00100000:3.0:1787836352.763420:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193129984:12345-0@lo:400: Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836352.763426:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787836352.763446:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787836352.763475:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3b80000 x1874682193129984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836352.763484:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787836352.763499:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193129984:0@lo:400: 00000100:00100000:2.0:1787836352.763574:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193129728 00000100:00100000:2.0:1787836352.763579:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193129728 00000100:00100000:2.0:1787836352.763622:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193129856 00000100:00100000:2.0:1787836352.763626:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193129856 00000100:00100000:2.0:1787836352.763649:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787836352.763656:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193129728:12345-0@lo:400: 00000100:00100000:2.0:1787836352.763695:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193129728:12345-0@lo:400: Request processed in 39us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836352.763701:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787836352.763714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787836352.763720:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193129856:12345-0@lo:400: 00000100:00100000:2.0:1787836352.763753:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193129856:12345-0@lo:400: Request processed in 33us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836352.763759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787836352.763773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787836352.763789:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3b83480 x1874682193129856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836352.763800:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193129856:0@lo:400: 00000100:00100000:0.0:1787836352.765756:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787836352.765871:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3b803c0 x1874682193129728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836352.765886:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193129728:0@lo:400: 00000100:00100000:2.0:1787836352.766078:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193129600 00000100:00100000:2.0:1787836352.766085:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193129600 00000100:00100000:2.0:1787836352.766136:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787836352.766145:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3311:x1874682193129600:12345-0@lo:400: 00000100:00100000:2.0:1787836352.766258:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3311:x1874682193129600:12345-0@lo:400: Request processed in 113us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836352.766266:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787836352.766445:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193129600:0@lo:400: 00000100:00100000:1.0:1787836353.262963:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193130112:0@lo:13: 00000100:00100000:1.0:1787836353.263043:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836353.263122:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193130112 00000100:00100000:1.0:1787836353.263128:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193130112 00000100:00100000:1.0:1787836353.263173:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836353.263182:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193130112:12345-0@lo:13: 00002000:00000024:1.0:1787836353.263223:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836353.263263:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193130112:12345-0@lo:13: Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836353.263270:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787836353.263305:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198f0c0 x1874682193130112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836353.263341:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193130112:0@lo:13: 00010000:00010000:2.0:1787836353.710302:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836354.735287:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836355.758278:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836356.785992:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836357.806780:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836357.876597:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193130624:0@lo:400: 00000100:00100000:1.0:1787836357.876670:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836357.876735:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836357.876741:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193130240:0@lo:400: 00000100:00100000:1.0:1787836357.876771:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836357.876802:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193130496:0@lo:400: 00000100:00100000:1.0:1787836357.876827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836357.876845:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836357.876850:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193130368:0@lo:400: 00000100:00100000:1.0:1787836357.876869:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836357.876895:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193130624 00000100:00100000:1.0:1787836357.876901:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193130624 00000100:00100000:1.0:1787836357.877018:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836357.877028:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193130624:12345-0@lo:400: 00000100:00100000:1.0:1787836357.877096:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193130624:12345-0@lo:400: Request processed in 70us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836357.877103:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836357.877127:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193130240 00000100:00100000:1.0:1787836357.877131:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193130240 00000100:00100000:1.0:1787836357.877153:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787836357.877160:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3310:x1874682193130240:12345-0@lo:400: 00000100:00100000:1.0:1787836357.877188:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3310:x1874682193130240:12345-0@lo:400: Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836357.877194:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787836357.877249:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193130240:0@lo:400: 00010000:00080000:1.0:1787836357.877262:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198f480 x1874682193130624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836357.877273:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193130624:0@lo:400: 00000100:00100000:3.0:1787836357.877378:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193130496 00000100:00100000:3.0:1787836357.877382:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193130496 00000100:00100000:3.0:1787836357.877416:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193130368 00000100:00100000:3.0:1787836357.877418:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193130368 00000100:00100000:3.0:1787836357.877442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787836357.877449:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193130496:12345-0@lo:400: 00000100:00100000:3.0:1787836357.877488:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193130496:12345-0@lo:400: Request processed in 40us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836357.877494:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787836357.877505:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787836357.877510:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193130368:12345-0@lo:400: 00000100:00100000:3.0:1787836357.877534:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193130368:12345-0@lo:400: Request processed in 24us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836357.877538:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787836357.877569:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198e580 x1874682193130368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836357.877578:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193130368:0@lo:400: 00010000:00080000:3.0:1787836357.877587:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198f0c0 x1874682193130496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836357.877594:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193130496:0@lo:400: 00000100:00080000:3.0:1787836357.887746:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836357.887756:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836358.384536:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193130752:0@lo:13: 00000100:00100000:3.0:1787836358.384613:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836358.384794:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193130752 00000100:00100000:1.0:1787836358.384809:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193130752 00000100:00100000:1.0:1787836358.384905:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836358.384916:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193130752:12345-0@lo:13: 00002000:00000024:1.0:1787836358.384951:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836358.385010:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193130752:12345-0@lo:13: Request processed in 94us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836358.385022:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787836358.385129:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3b68780 x1874682193130752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836358.385157:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193130752:0@lo:13: 00010000:00010000:2.0:1787836358.841396:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836359.855199:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787836360.696456:0:7625:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787836360.696459:0:7625:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787836360.696584:0:7625:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e2c1c4b800 00000020:01000004:2.0:1787836360.696599:0:7625:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787836360.696610:0:7625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787836360.696631:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98e3d8283490) 00000020:00000080:2.0:1787836360.696649:0:7625:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787836360.754671:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787836360.759131:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787836360.804344:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787836360.810984:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787836360.811019:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787836360.811253:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787836360.811283:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787836360.811616:0:7625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787836360.811629:0:7625:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787836360.811640:0:7625:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x966835ea68ab7359 00000020:01000004:3.0:1787836360.811650:0:7625:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787836360.811946:0:7625:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787836360.811950:0:7625:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787836360.811956:0:7625:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787836360.811977:0:7625:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787836360.811981:0:7625:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787836360.851784:0:7625:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787836360.851824:0:7625:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.125@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787836360.851829:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787836360.851830:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787836360.851832:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836360.851833:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787836360.851834:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836360.851840:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836360.851841:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787836360.851843:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787836360.851844:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787836360.851846:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836360.851846:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787836360.851950:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787836360.851954:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787836360.851955:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787836360.851956:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836360.851957:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787836360.851958:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836360.851959:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836360.851960:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787836360.851961:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787836360.851962:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787836360.851963:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836360.851964:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787836360.852000:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787836360.852020:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193130880:0@lo:253: 00000100:00100000:0.0:1787836360.852322:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836360.852406:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e401d8c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836360.852451:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193130880 00000100:00100000:1.0:1787836360.852459:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193130880 00000100:00100000:1.0:1787836360.852556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787836360.852566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:7625:x1874682193130880:12345-0@lo:253: 20000000:01000000:1.0:1787836360.852596:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787836360.852599:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787836360.852604:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787836360.852607:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787836360.853980:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787836360.854318:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787836360.854334:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787836360.854398:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787836360.854429:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787836360.854506:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787836360.854592:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787836360.855186:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787836360.855207:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:1.0:1787836360.855209:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787836360.855244:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787836360.855256:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787836360.859387:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787836360.859418:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:1.0:1787836360.859515:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787836360.859525:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787836360.859557:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787836360.859636:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787836360.861416:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787836360.861451:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.125@tcp 20000000:01000000:1.0:1787836360.861454:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787836360.861494:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787836360.861502:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787836360.861532:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787836360.861539:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.125@tcp (null) (null) 00000040:00080000:1.0:1787836360.861569:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787836360.861577:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787836360.861635:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787836360.861671:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787836360.861687:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787836360.861690:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787836360.861696:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787836360.861698:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787836360.861700:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787836360.861711:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787836360.861720:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787836360.861760:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787836360.861762:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787836360.862545:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787836360.862603:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787836360.862656:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787836360.863466:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787836360.863536:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787836360.863621:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787836360.863645:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787836360.863649:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787836360.865215:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787836360.865654:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787836360.866031:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787836360.866316:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787836360.866335:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787836360.866338:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787836360.868026:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787836360.868320:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787836360.868412:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787836360.869381:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787836360.869485:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787836360.869993:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787836360.870014:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787836360.870019:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787836360.872494:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787836360.872636:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787836360.872728:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787836360.873298:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787836360.873356:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787836360.873421:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1787836360.873442:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787836360.873468:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.873495:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c152a400/0x966835ea68ab72a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab729c expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.873506:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.873531:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.873537:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab730c expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.873544:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7344 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.873551:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.873604:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7344 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.873627:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7344 expref: 16 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.873650:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131008:0@lo:104: 00000100:00100000:2.0:1787836360.873757:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836360.874011:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787836360.874042:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193131008 00000100:00100000:0.0:1787836360.874053:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193131008 00000100:00100000:0.0:1787836360.874135:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836360.874150:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5835:x1874682193131008:12345-0@lo:104: 00010000:00010000:0.0:1787836360.874168:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874245:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836360.874254:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5835:x1874682193131008:12345-0@lo:104: Request processed in 109us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.874263:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787836360.874335:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836360.874341:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874349:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152ac00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836360.874353:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874362:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836360.874369:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836360.874376:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787836360.874432:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874443:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836360.874480:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874491:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab7344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab734b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874512:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.874515:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.874518:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836360.874529:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787836360.874542:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193131264:0@lo:103: 00000100:00100000:0.0:1787836360.874571:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.874629:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193131264 00000100:00100000:3.0:1787836360.874634:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193131264 00010000:00010000:3.0:1787836360.874655:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7344 expref: 17 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.874659:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab730c expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.874670:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab730c expref: 17 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.874680:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131136:0@lo:104: 00000100:00100000:3.0:1787836360.874694:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787836360.874700:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b82d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:3313:x1874682193131264:12345-0@lo:103: 00000100:00100000:2.0:1787836360.874704:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836360.874710:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836360.874715:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7344 expref: 17 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.874725:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7344 expref: 17 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.874739:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836360.874785:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193131136 00000100:00100000:0.0:1787836360.874792:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193131136 00000100:00100000:0.0:1787836360.874836:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787836360.874847:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5835:x1874682193131136:12345-0@lo:104: 00010000:00010000:0.0:1787836360.874882:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874943:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836360.874948:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5835:x1874682193131136:12345-0@lo:104: Request processed in 105us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.874954:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787836360.874969:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836360.874973:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874980:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e40216de00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836360.874983:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.874991:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836360.874998:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836360.875004:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787836360.875029:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875037:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836360.875115:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875128:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e40216de00/0x966835ea68ab730c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7313 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875147:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.875149:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.875151:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836360.875195:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193131520:0@lo:103: 00000100:00100000:0.0:1787836360.875242:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787836360.875451:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 17 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.875465:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131392:0@lo:104: 00000100:00100000:2.0:1787836360.875507:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836360.875574:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193131392 00000100:00100000:0.0:1787836360.875582:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193131392 00000100:00100000:0.0:1787836360.875625:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787836360.875637:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3dde940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5835:x1874682193131392:12345-0@lo:104: 00010000:00010000:0.0:1787836360.875649:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875707:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836360.875714:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3dde940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5835:x1874682193131392:12345-0@lo:104: Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.875723:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787836360.875749:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836360.875755:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875763:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031a00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836360.875769:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875797:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836360.875804:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836360.875809:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787836360.875834:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875839:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836360.875868:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875875:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab72f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.875887:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.875889:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.875890:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836360.876272:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787836360.876281:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787836360.876438:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193131520 00000100:00100000:0.0:1787836360.876446:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193131520 00010000:00010000:0.0:1787836360.876477:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab730c expref: 18 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836360.876511:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787836360.876526:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787836360.876532:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:3313:x1874682193131520:12345-0@lo:103: 00010000:00010000:0.0:1787836360.876551:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836360.876556:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab730c expref: 18 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836360.876836:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193131648:0@lo:103: 00000100:00100000:1.0:1787836360.876929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836360.877189:0:7631:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787836360.877199:0:7631:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1787836360.877234:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787836360.877246:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193131648 00000100:00100000:1.0:1787836360.877253:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193131648 00010000:00010000:1.0:1787836360.877275:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 19 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836360.877290:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787836360.877297:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787836360.877303:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193131648:12345-0@lo:103: 00010000:00010000:1.0:1787836360.877325:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836360.877330:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 19 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.877381:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836360.877424:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b82d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193131264:12345-0@lo:103: Request processed in 2724us (2851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.877432:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787836360.877873:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.877895:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 18 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.877913:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131776:0@lo:104: 00000100:00100000:2.0:1787836360.877953:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787836360.878008:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c152a400/0x966835ea68ab72a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab729c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.878022:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c152a400/0x966835ea68ab72a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab729c expref: 18 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.878035:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131904:0@lo:104: 00000100:00100000:2.0:1787836360.878104:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836360.878141:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e565aa80 going to sleep for 11 seconds 00010000:00010000:2.0:1787836360.878175:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e40216c800/0x966835ea68ab734b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7344 expref: 18 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.878199:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131008:0@lo:104: 00000100:00100000:2.0:1787836360.878220:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131136:0@lo:104: 00000100:00100000:2.0:1787836360.878235:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131392:0@lo:104: 00000100:00100000:3.0:1787836360.878384:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193131776 00000100:00100000:3.0:1787836360.878389:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193131776 00000100:00100000:3.0:1787836360.878412:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193131904 00000100:00100000:3.0:1787836360.878415:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193131904 00010000:00010000:0.0:1787836360.878417:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab730c expref: 17 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.878426:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787836360.878432:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:5835:x1874682193131776:12345-0@lo:104: 00010000:00010000:0.0:1787836360.878436:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e40216cc00/0x966835ea68ab7313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab730c expref: 17 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.878442:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.878447:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836360.878476:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3313:x1874682193131520:12345-0@lo:103: Request processed in 1944us (3235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.878483:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787836360.878491:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787836360.878495:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:5835:x1874682193131776:12345-0@lo:104: Request processed in 64us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.878501:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787836360.878514:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787836360.878519:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3dded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5835:x1874682193131904:12345-0@lo:104: 00010000:00010000:3.0:1787836360.878532:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c0030a00/0x966835ea68ab729c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.878564:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787836360.878569:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3dded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5835:x1874682193131904:12345-0@lo:104: Request processed in 50us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.878575:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787836360.878582:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193131520:0@lo:103: 00000100:00100000:0.0:1787836360.878591:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193131264:0@lo:103: 00010000:00010000:0.0:1787836360.878620:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787836360.878625:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.878632:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152be00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836360.878636:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.878644:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836360.878652:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.878825:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131776:0@lo:104: 00000100:00100000:2.0:1787836360.878839:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874682193131904:0@lo:104: 00010000:00010000:2.0:1787836360.878898:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836360.879053:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787836360.879147:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836360.879268:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.879276:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836360.879301:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.879317:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c152be00/0x966835ea68ab72c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72cd expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.879328:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.879329:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.879331:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836360.879476:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836360.879498:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193132032:0@lo:103: 00000100:00100000:0.0:1787836360.879549:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787836360.879662:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836360.879799:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c0030a00/0x966835ea68ab729c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.879810:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030a00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836360.879815:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0030a00/0x966835ea68ab729c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.879826:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0030a00/0x966835ea68ab729c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836360.879837:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0030a00/0x966835ea68ab729c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836360.879960:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787836360.880004:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193132032 00000100:00100000:3.0:1787836360.880010:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193132032 00010000:00010000:3.0:1787836360.880048:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 16 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.880171:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787836360.880186:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3310:x1874682193132032:12345-0@lo:103: 00010000:00010000:3.0:1787836360.880204:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836360.880213:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 16 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.880229:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 16 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.880252:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e40216d000/0x966835ea68ab72cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab72c6 expref: 16 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.880271:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836360.880321:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:3310:x1874682193132032:12345-0@lo:103: Request processed in 140us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.880327:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787836360.880372:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193132032:0@lo:103: 00010000:00010000:1.0:1787836360.880501:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 14 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836360.880521:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0030800/0x966835ea68ab72f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab72f0 expref: 14 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836360.880539:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836360.880578:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3310:x1874682193131648:12345-0@lo:103: Request processed in 3276us (3652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836360.880585:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787836360.880635:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836360.880640:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836360.880840:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193131648:0@lo:103: 00010000:00010000:1.0:1787836360.881499:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c0030a00/0x966835ea68ab729c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836360.881508:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787836360.881552:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193132160:0@lo:103: 00000100:00100000:0.0:1787836360.881595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787836360.881660:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c0030a00/0x966835ea68ab729c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836360.881668:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0030a00/0x966835ea68ab729c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72a3 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.881753:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193132160 00000100:00100000:3.0:1787836360.881758:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193132160 00010000:00010000:3.0:1787836360.881781:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c152a400/0x966835ea68ab72a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab729c expref: 13 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.881803:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787836360.881809:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3312:x1874682193132160:12345-0@lo:103: 00010000:00010000:3.0:1787836360.881819:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836360.881822:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c152a400/0x966835ea68ab72a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab729c expref: 13 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881830:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c152a400/0x966835ea68ab72a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab729c expref: 13 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881842:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c152a400/0x966835ea68ab72a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab729c expref: 13 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881866:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881874:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881888:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881894:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881912:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881918:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881923:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005aa00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836360.881926:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881934:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881948:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.881959:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836360.882099:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836360.882101:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836360.882103:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836360.882284:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:3312:x1874682193132160:12345-0@lo:103: Request processed in 474us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.882290:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787836360.882324:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.882332:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.882339:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005aa00/0x966835ea68ab7360 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787836360.882351:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787836360.882509:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193132160:0@lo:103: 00000100:00100000:0.0:1787836360.932660:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:7625:x1874682193130880:12345-0@lo:253: Request processed in 80086us (80328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.932684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787836360.932972:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b82580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193130880:0@lo:253: 10000000:01000000:2.0:1787836360.932988:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787836360.932991:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787836360.932993:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787836360.932994:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836360.932996:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787836360.932997:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836360.932998:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836360.933000:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836360.933001:0:7625:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787836360.933003:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836360.933004:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787836360.933028:0:7625:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e2c1c4b800 from lustre-OST0001 10000000:01000000:2.0:1787836360.933172:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787836360.933177:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787836360.933189:0:7625:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e3c7faced8 local copy 10000000:01000000:2.0:1787836360.933195:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787836360.933247:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.933262:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.933273:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.933320:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132288:0@lo:101: 00000100:00100000:2.0:1787836360.933365:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836360.933474:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e565ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787836360.933582:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193132288 00000100:00100000:0.0:1787836360.933590:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193132288 00000100:00100000:0.0:1787836360.933679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787836360.933689:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+11:7625:x1874682193132288:12345-0@lo:101: 00010000:00010000:0.0:1787836360.933701:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836360.933715:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0031a00/0x966835ea68ab736e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7367 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.933739:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0031a00/0x966835ea68ab736e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7367 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.933749:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0031a00/0x966835ea68ab736e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7367 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.933758:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031a00, rc 0) 00000100:00100000:0.0:1787836360.933805:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193132288:12345-0@lo:101: Request processed in 117us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.933811:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787836360.933885:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132288:0@lo:101: 00010000:00010000:3.0:1787836360.933900:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.933909:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.934012:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132416:0@lo:501: 00000100:00100000:3.0:1787836360.934044:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.934421:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836360.934509:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193132416 00000100:00100000:2.0:1787836360.934515:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193132416 00000100:00100000:2.0:1787836360.934541:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787836360.934547:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193132416:12345-0@lo:501: 00000100:00100000:2.0:1787836360.934779:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193132416:12345-0@lo:501: Request processed in 228us (730us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787836360.934789:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787836360.935040:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132416:0@lo:501: 10000000:01000000:3.0:1787836360.935088:0:7625:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787836360.935132:0:7625:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787836360.935143:0:7625:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.935154:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.935163:0:7625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.935189:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787836360.935220:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e2c1c4b800 10000000:01000000:3.0:1787836360.935228:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787836360.935236:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787836360.935240:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787836360.935246:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787836360.935264:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787836360.935289:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.935297:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.935305:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.935330:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132544:0@lo:101: 00000100:00100000:3.0:1787836360.935363:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.935386:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787836360.935441:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836360.935448:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.935455:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005aa00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:2.0:1787836360.935459:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.935467:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787836360.935473:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836360.935478:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787836360.935497:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.935512:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787836360.935542:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.935548:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab7367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x966835ea68ab736e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.935559:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836360.935561:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836360.935562:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836360.935573:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193132544 00000100:00100000:2.0:1787836360.935577:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193132544 00000100:00100000:2.0:1787836360.935600:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787836360.935605:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193132544:12345-0@lo:101: 00010000:00010000:2.0:1787836360.935614:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836360.935623:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7375 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.935642:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7375 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.935653:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7375 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.935660:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836360.935703:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193132544:12345-0@lo:101: Request processed in 97us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836360.935709:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787836360.935886:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193132672:0@lo:103: 00000100:00100000:3.0:1787836360.935934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.935970:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193132672 00000100:00100000:3.0:1787836360.935974:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193132672 00000100:00100000:3.0:1787836360.936003:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836360.936010:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b69680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3313:x1874682193132672:12345-0@lo:103: 00010000:00010000:3.0:1787836360.936019:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836360.936031:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031a00/0x966835ea68ab736e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab7367 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.936040:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836360.936114:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b69680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:3313:x1874682193132672:12345-0@lo:103: Request processed in 105us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.936120:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836360.936148:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193132672:0@lo:103: 00000100:00100000:3.0:1787836360.936174:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132544:0@lo:101: 00010000:00010000:3.0:1787836360.936194:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.936203:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.936280:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132800:0@lo:501: 00000100:00100000:3.0:1787836360.936317:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.936336:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836360.936529:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193132800 00000100:00100000:2.0:1787836360.936534:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193132800 00000100:00100000:2.0:1787836360.936557:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787836360.936568:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193132800:12345-0@lo:501: 00000100:00100000:2.0:1787836360.936828:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193132800:12345-0@lo:501: Request processed in 262us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836360.936835:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787836360.937024:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132800:0@lo:501: 00000100:00100000:3.0:1787836360.937095:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132928:0@lo:503: 00000100:00100000:3.0:1787836360.937139:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.937164:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836360.937217:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193132928 00000100:00100000:0.0:1787836360.937231:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193132928 00000100:00100000:0.0:1787836360.937256:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787836360.937262:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193132928:12345-0@lo:503: 00000100:00100000:0.0:1787836360.937488:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193132928:12345-0@lo:503: Request processed in 222us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.937499:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787836360.937749:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193132928:0@lo:503: 00000040:00080000:3.0:1787836360.938139:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787836360.938215:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133056:0@lo:502: 00000100:00100000:3.0:1787836360.938280:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.938306:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836360.938407:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193133056 00000100:00100000:0.0:1787836360.938412:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193133056 00000100:00100000:0.0:1787836360.938446:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787836360.938454:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193133056:12345-0@lo:502: 00000100:00100000:0.0:1787836360.938610:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193133056:12345-0@lo:502: Request processed in 157us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.938616:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787836360.938790:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133056:0@lo:502: 00000040:00080000:3.0:1787836360.939217:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787836360.939266:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787836360.939298:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787836360.939362:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787836360.939398:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787836360.939469:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787836360.939519:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133184:0@lo:502: 00000100:00100000:3.0:1787836360.939589:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.939633:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836360.939845:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193133184 00000100:00100000:0.0:1787836360.939970:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193133184 00000100:00100000:0.0:1787836360.940270:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787836360.940280:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193133184:12345-0@lo:502: 00000100:00100000:0.0:1787836360.940592:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193133184:12345-0@lo:502: Request processed in 310us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.940606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787836360.941239:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133184:0@lo:502: 00000040:00080000:3.0:1787836360.941517:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787836360.941537:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787836360.947374:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787836360.947391:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787836360.947400:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836360.947403:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787836360.947414:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787836360.947435:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98e3d83e8000) 00000020:00000080:0.0:1787836360.947469:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787836360.947480:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787836360.947582:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e2c1c4b800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787836360.947595:0:7635:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787836360.947605:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x966835ea68ab738a 00010000:00010000:0.0:1787836360.954028:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787836360.954956:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787836360.959182:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787836360.959492:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787836360.966399:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787836360.967594:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787836360.970119:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787836360.970134:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787836360.970143:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836360.970145:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787836360.970149:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787836360.970152:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836360.970154:0:7635:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787836360.970157:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787836360.970158:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787836360.970214:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787836360.970217:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836360.970219:0:7635:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787836360.970221:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787836360.972438:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787836360.972486:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787836360.972531:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.972543:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836360.972552:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e2c1c4b800 from 1 10000000:01000000:3.0:1787836360.972554:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787836360.972602:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.972612:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.972628:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.972663:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133312:0@lo:101: 00000100:00100000:3.0:1787836360.972744:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.972784:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836360.972813:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193133312 00000100:00100000:3.0:1787836360.972821:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193133312 00000100:00100000:3.0:1787836360.973009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787836360.973026:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:7625:x1874682193133312:12345-0@lo:101: 00010000:00010000:3.0:1787836360.973046:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836360.973098:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7391 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.973135:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7391 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.973151:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7391 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.973163:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a800, rc 0) 00000100:00100000:3.0:1787836360.973232:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133312:12345-0@lo:101: Request processed in 210us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.973243:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787836360.973442:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133312:0@lo:101: 00010000:00010000:3.0:1787836360.973464:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.973476:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.973610:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133440:0@lo:501: 00000100:00100000:3.0:1787836360.973659:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.973943:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836360.973963:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193133440 00000100:00100000:3.0:1787836360.973967:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193133440 00000100:00100000:3.0:1787836360.974000:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787836360.974012:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133440:12345-0@lo:501: 00000100:00100000:3.0:1787836360.974244:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133440:12345-0@lo:501: Request processed in 232us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.974252:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787836360.974936:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133440:0@lo:501: 00000100:00100000:3.0:1787836360.974975:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133568:0@lo:503: 00000100:00100000:3.0:1787836360.975017:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.975621:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836360.975638:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193133568 00000100:00100000:3.0:1787836360.975642:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193133568 00000100:00100000:1.0:1787836360.980179:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787836360.980210:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133568:12345-0@lo:503: 00000100:00100000:1.0:1787836360.980822:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133568:12345-0@lo:503: Request processed in 625us (5802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836360.980830:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787836360.981101:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133568:0@lo:503: 00000040:00080000:2.0:1787836360.981423:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787836360.981510:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133696:0@lo:502: 00000100:00100000:2.0:1787836360.981559:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836360.981601:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e565ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787836360.981784:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193133696 00000100:00100000:1.0:1787836360.981793:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193133696 00000100:00100000:1.0:1787836360.981836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787836360.981955:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133696:12345-0@lo:502: 00000100:00100000:1.0:1787836360.982175:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133696:12345-0@lo:502: Request processed in 329us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836360.982182:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787836360.982295:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133696:0@lo:502: 00000040:00080000:2.0:1787836360.982542:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787836360.982589:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787836360.982614:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133824:0@lo:502: 00000100:00100000:2.0:1787836360.982651:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836360.982957:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e565ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787836360.982994:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193133824 00000100:00100000:1.0:1787836360.982999:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193133824 00000100:00100000:1.0:1787836360.983024:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787836360.983030:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133824:12345-0@lo:502: 00000100:00100000:1.0:1787836360.984199:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133824:12345-0@lo:502: Request processed in 1162us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836360.984209:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787836360.986244:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133824:0@lo:502: 00000040:00080000:3.0:1787836360.986491:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787836360.986506:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787836360.987763:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787836360.987774:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836360.987777:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787836360.987784:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e2c1c4b800 00000020:00000080:0.0:1787836360.987788:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787836360.987825:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787836360.987831:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836360.987833:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787836360.987838:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787836360.988559:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787836360.988610:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787836360.988763:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.988775:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836360.988819:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787836360.988822:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e2c1c4b800 10000000:01000000:3.0:1787836360.988825:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e2c1c4b800 10000000:01000000:3.0:1787836360.988829:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787836360.988834:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e2c1c4b800 from 1 10000000:01000000:3.0:1787836360.988836:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787836360.988890:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.988921:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836360.988938:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836360.988962:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133952:0@lo:101: 00000100:00100000:3.0:1787836360.989029:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836360.989138:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece540 going to sleep for 11 seconds 00000100:00100000:0.0:1787836360.989556:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193133952 00000100:00100000:0.0:1787836360.989565:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193133952 00000100:00100000:0.0:1787836360.989644:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787836360.989661:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193133952:12345-0@lo:101: 00010000:00010000:0.0:1787836360.989686:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836360.989700:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab739f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.989723:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab739f expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.989734:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab739f expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836360.989743:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031800, rc 0) 00000100:00100000:0.0:1787836360.989799:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193133952:12345-0@lo:101: Request processed in 143us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.989806:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787836360.990080:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193133952:0@lo:101: 00010000:00010000:2.0:1787836360.990098:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836360.990107:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836360.990335:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193134080:0@lo:501: 00000100:00100000:2.0:1787836360.990415:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836360.990468:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e565ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787836360.990657:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193134080 00000100:00100000:0.0:1787836360.990730:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193134080 00000100:00100000:0.0:1787836360.990774:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787836360.990781:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193134080:12345-0@lo:501: 00000100:00100000:0.0:1787836360.991121:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193134080:12345-0@lo:501: Request processed in 339us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.991129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787836360.991197:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193134080:0@lo:501: 00000100:00100000:0.0:1787836360.991233:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193134208:0@lo:503: 00000100:00100000:0.0:1787836360.991487:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836360.991517:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e401d8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836360.991559:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193134208 00000100:00100000:2.0:1787836360.991564:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193134208 00000100:00100000:2.0:1787836360.991595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787836360.991602:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193134208:12345-0@lo:503: 00000100:00100000:2.0:1787836360.992116:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193134208:12345-0@lo:503: Request processed in 509us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836360.992129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787836360.992423:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193134208:0@lo:503: 00000040:00080000:0.0:1787836360.992969:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787836360.993048:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193134336:0@lo:502: 00000100:00100000:0.0:1787836360.993354:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836360.993432:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787836360.993470:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193134336 00000100:00100000:3.0:1787836360.993475:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193134336 00000100:00100000:3.0:1787836360.993543:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787836360.993552:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193134336:12345-0@lo:502: 00000100:00100000:3.0:1787836360.993841:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193134336:12345-0@lo:502: Request processed in 290us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836360.993924:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787836360.994003:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193134336:0@lo:502: 00000040:00080000:2.0:1787836360.994351:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787836360.994405:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787836360.994445:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787836360.994496:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787836360.994538:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787836360.994588:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787836360.994628:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787836360.994675:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787836360.994728:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787836360.994766:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787836360.994800:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787836360.994867:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787836360.994940:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787836360.995003:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787836360.995152:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787836360.995229:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787836360.995299:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787836360.995407:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787836360.995480:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787836360.995537:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787836360.995660:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787836360.995727:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787836360.995794:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787836360.995893:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787836360.996001:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787836360.996122:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787836360.996237:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787836360.996336:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787836360.996408:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787836360.996532:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787836360.996581:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787836360.996648:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787836360.996741:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787836360.996833:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787836360.996897:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787836360.996989:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787836360.997105:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787836360.997183:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193134464:0@lo:502: 00000100:00100000:2.0:1787836360.997297:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836360.998688:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e565a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836360.999008:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193134464 00000100:00100000:0.0:1787836360.999018:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193134464 00000100:00100000:0.0:1787836360.999099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787836360.999110:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193134464:12345-0@lo:502: 00000100:00100000:0.0:1787836360.999515:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193134464:12345-0@lo:502: Request processed in 406us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836360.999523:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787836360.999641:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193134464:0@lo:502: 00000040:00080000:2.0:1787836360.999760:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787836360.999775:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787836361.000553:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787836361.000567:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98e3d8281a48) 00000020:00000080:2.0:1787836361.000588:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787836361.000655:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e2c1c4b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787836361.000659:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e2c1c4b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787836361.000674:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e2c1c4b800 3 00010000:00080000:2.0:1787836361.000704:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e401d42000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1787836361.006240:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787836361.006569:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787836361.006605:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787836361.006630:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x966835ea68ab73b4 00000100:00080000:2.0:1787836361.006640:0:7640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787836361.006646:0:7640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98e401d42000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1787836361.006744:0:7640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3d3ddcb40 x1874682193134592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787836361.006778:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874682193134592:0@lo:38: 00000100:00100000:2.0:1787836361.006837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787836361.007009:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787836361.009177:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193134592 00000100:00100000:1.0:1787836361.009189:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193134592 00000100:00100000:1.0:1787836361.009227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836361.009235:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874682193134592:12345-0@lo:38: 00010000:00080000:1.0:1787836361.009260:0:5843:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1787836361.009302:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x966835ea68ab73bb 00000004:00100000:1.0:1787836361.009327:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787836361.009362:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98e3d01ca800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836361.009447:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874682193134592:12345-0@lo:38: Request processed in 212us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836361.009455:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787836361.010602:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3ddcb40 x1874682193134592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787836371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836361.010621:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787836361.010633:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787836361.010648:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787836361.010656:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787836361.010662:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e401d42000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787836361.013168:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193134976:0@lo:400: 00000100:00100000:1.0:1787836361.013242:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836361.013323:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193134848:0@lo:400: 00000100:00100000:1.0:1787836361.013349:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836361.013370:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836361.013387:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193134720:0@lo:400: 00000100:00100000:1.0:1787836361.013411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836361.013443:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193134848 00000100:00100000:1.0:1787836361.013450:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193134848 00000100:00100000:1.0:1787836361.013500:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193134720 00000100:00100000:1.0:1787836361.013504:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193134720 00000100:00100000:1.0:1787836361.013518:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787836361.013526:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193134848:12345-0@lo:400: 00000100:00100000:1.0:1787836361.013580:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193134848:12345-0@lo:400: Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836361.013587:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787836361.013604:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787836361.013611:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193134720:12345-0@lo:400: 00000100:00100000:1.0:1787836361.013637:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193134720:12345-0@lo:400: Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836361.013644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787836361.013691:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3b69a40 x1874682193134720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836361.013704:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193134720:0@lo:400: 00010000:00080000:1.0:1787836361.013715:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3b683c0 x1874682193134848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836361.013723:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193134848:0@lo:400: 00000100:00100000:3.0:1787836361.015842:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193134976 00000100:00100000:3.0:1787836361.015867:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193134976 00000100:00100000:3.0:1787836361.015926:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787836361.015936:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193134976:12345-0@lo:400: 00000100:00100000:3.0:1787836361.016024:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193134976:12345-0@lo:400: Request processed in 89us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836361.016031:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787836361.016080:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787836361.016085:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787836361.016119:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3d3b6ad00 x1874682193134976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836361.016148:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193134976:0@lo:400: 00000100:00100000:2.0:1787836361.018814:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874682193134592:0@lo:38: 00000040:00080000:2.0:1787836361.019488:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1787836361.019610:0:7625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787836361.019636:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787836361.020177:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836361.020190:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787836361.020246:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787836361.020248:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787836361.020249:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836361.020250:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787836361.020252:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836361.020253:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836361.020254:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787836361.020256:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787836361.020257:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787836361.020259:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836361.020260:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787836361.020263:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787836361.020348:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787836361.020349:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787836361.020350:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836361.020351:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787836361.020352:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836361.020353:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836361.020354:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787836361.020355:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787836361.020356:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787836361.020356:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836361.020357:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787836361.020382:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787836361.020398:0:7625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193135104:0@lo:253: 00000100:00100000:0.0:1787836361.020464:0:7625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836361.020509:0:7625:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981540 going to sleep for 11 seconds 00000100:00100000:2.0:1787836361.020562:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193135104 00000100:00100000:2.0:1787836361.020572:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193135104 00000100:00100000:2.0:1787836361.020764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787836361.020779:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7625:x1874682193135104:12345-0@lo:253: 20000000:01000000:2.0:1787836361.020817:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787836361.020835:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787836361.022015:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1874682193135232:0@lo:901: 00000100:00100000:1.0:1787836361.022149:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836361.022235:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d06d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1787836361.025621:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193135232 00000100:00100000:0.0:1787836361.025635:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193135232 00000100:00100000:0.0:1787836361.025712:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836361.025722:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1874682193135232:12345-0@lo:901: 00000100:00080000:1.0:1787836361.025980:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836361.026784:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1874682193135232:12345-0@lo:901: Request processed in 1058us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836361.026800:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787836361.030106:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c198e580 x1874682193135232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787836377 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836361.030126:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1874682193135232:0@lo:901: 20000000:01000000:3.0:1787836361.052584:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787836361.052618:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787836361.052751:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787836361.052755:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787836361.052776:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836361.052796:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab72fe expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836361.052805:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836361.052845:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab72fe expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836361.052888:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab72fe expref: 14 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836361.052904:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b80f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874682193135360:0@lo:104: 00000100:00100000:0.0:1787836361.052976:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836361.053026:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d09816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836361.053454:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193135360 00000100:00100000:3.0:1787836361.053464:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193135360 00000100:00100000:3.0:1787836361.053532:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787836361.053542:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5857:x1874682193135360:12345-0@lo:104: 00010000:00010000:3.0:1787836361.053555:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836361.053652:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787836361.053662:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:5857:x1874682193135360:12345-0@lo:104: Request processed in 121us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836361.053679:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787836361.054153:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b80f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874682193135360:0@lo:104: 00010000:00010000:0.0:1787836361.054199:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836361.054862:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836361.054871:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836361.054879:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e40216c200 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836361.054882:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836361.054890:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836361.054896:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836361.054900:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836361.054943:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836361.054951:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836361.054970:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836361.054978:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e40216c200/0x966835ea68ab72fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7305 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836361.054996:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836361.054998:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836361.055014:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836361.055030:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193135488:0@lo:103: 00000100:00100000:1.0:1787836361.055101:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836361.055217:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193135488 00000100:00100000:2.0:1787836361.055230:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193135488 00010000:00010000:2.0:1787836361.055260:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab72fe expref: 15 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836361.055342:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787836361.055359:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8600850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:3313:x1874682193135488:12345-0@lo:103: 00010000:00010000:2.0:1787836361.055380:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836361.055388:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab72fe expref: 15 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055406:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab72fe expref: 15 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055428:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e40216d400/0x966835ea68ab7305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab72fe expref: 15 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055453:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055466:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787836361.055487:0:7632:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004990709s 00010000:00010000:2.0:1787836361.055495:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055506:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055516:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055535:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055540:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031c00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836361.055544:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055551:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055588:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836361.055605:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836361.055682:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8600850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:3313:x1874682193135488:12345-0@lo:103: Request processed in 329us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836361.055689:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787836361.055772:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193135488:0@lo:103: 00010000:00010000:1.0:1787836361.056023:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836361.056032:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836361.056038:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031c00/0x966835ea68ab73c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836361.065906:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:7625:x1874682193135104:12345-0@lo:253: Request processed in 45063us (45372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836361.065922:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787836361.066009:0:7625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e8e7a0a-4610-42c5-99e6-210da529f97c:7625:1874682193135104:0@lo:253: 10000000:01000000:2.0:1787836361.066025:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787836361.066028:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787836361.066030:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787836361.066031:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836361.066032:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836361.066034:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836361.066036:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836361.066037:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836361.066039:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787836361.066040:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787836361.066041:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836361.066128:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787836361.066149:0:7625:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787836361.072807:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836361.073170:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836361.073454:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836361.073640:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836361.074437:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836361.074837:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787836361.078207:0:7625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787836361.435153:0:7625:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787836361.435163:0:7625:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787836361.438130:0:7625:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787836361.438223:0:7625:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787836361.438246:0:7625:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787836361.438623:0:7625:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787836361.902267:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836362.926208:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836363.503306:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836363.503333:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193135616:0@lo:13: 00000100:00100000:2.0:1787836363.503418:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836363.503555:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193135616 00000100:00100000:3.0:1787836363.503562:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193135616 00000100:00080000:1.0:1787836363.503738:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836363.503796:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787836363.503811:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193135616:12345-0@lo:13: 00002000:00000024:3.0:1787836363.503859:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836363.503915:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193135616:12345-0@lo:13: Request processed in 109us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836363.503922:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787836363.507895:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b68f00 x1874682193135616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836363.507924:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193135616:0@lo:13: 00010000:00010000:0.0:1787836363.951430:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836364.979514:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836365.998331:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836366.062307:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193136128:0@lo:400: 00000100:00100000:3.0:1787836366.062392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.062465:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787836366.062471:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193135744:0@lo:400: 00000100:00100000:3.0:1787836366.062502:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.062524:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193136256:0@lo:400: 00000100:00100000:3.0:1787836366.062551:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.062579:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193135872:0@lo:400: 00000100:00100000:3.0:1787836366.062623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.062645:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787836366.062650:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193136000:0@lo:400: 00000100:00100000:3.0:1787836366.062671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.062699:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193136128 00000100:00100000:3.0:1787836366.062707:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193136128 00000100:00100000:3.0:1787836366.062771:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787836366.062780:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193136128:12345-0@lo:400: 00000100:00100000:3.0:1787836366.062832:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193136128:12345-0@lo:400: Request processed in 53us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.062839:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787836366.062859:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193135744 00000100:00100000:3.0:1787836366.062862:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193135744 00000100:00100000:3.0:1787836366.062882:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787836366.062887:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3310:x1874682193135744:12345-0@lo:400: 00000100:00100000:3.0:1787836366.062912:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:3310:x1874682193135744:12345-0@lo:400: Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.062918:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787836366.062943:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193136256 00000100:00100000:3.0:1787836366.062953:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193136256 00000100:00100000:3.0:1787836366.062973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193135872 00000100:00100000:3.0:1787836366.062976:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193135872 00000100:00100000:3.0:1787836366.062987:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193136000 00000100:00100000:3.0:1787836366.062989:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193136000 00000100:00100000:3.0:1787836366.063004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787836366.063010:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193136256:12345-0@lo:400: 00000100:00100000:3.0:1787836366.063040:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193136256:12345-0@lo:400: Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.063046:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787836366.063085:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787836366.063092:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193135872:12345-0@lo:400: 00000100:00100000:3.0:1787836366.063121:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193135872:12345-0@lo:400: Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.063126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787836366.063136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787836366.063142:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193136000:12345-0@lo:400: 00000100:00100000:3.0:1787836366.063167:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193136000:12345-0@lo:400: Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.063173:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787836366.063196:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836366.063201:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787836366.063230:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b6ad00 x1874682193136000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.063243:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193136000:0@lo:400: 00010000:00080000:3.0:1787836366.063252:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b68780 x1874682193135872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.063284:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193135872:0@lo:400: 00000100:00100000:3.0:1787836366.063311:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193135744:0@lo:400: 00010000:00080000:3.0:1787836366.063321:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b69680 x1874682193136256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.063328:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193136256:0@lo:400: 00010000:00080000:3.0:1787836366.063337:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b68f00 x1874682193136128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.063345:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193136128:0@lo:400: 10000000:01000000:3.0:1787836366.583110:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787836366.583118:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3d01b2000 from 30 10000000:01000000:3.0:1787836366.583123:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787836366.583182:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.583196:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.583208:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836366.583233:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193136384:0@lo:101: 00000100:00100000:3.0:1787836366.583316:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.583363:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e951ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836366.585042:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193136384 00000100:00100000:0.0:1787836366.585054:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193136384 00000100:00100000:0.0:1787836366.585122:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787836366.585130:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193136384:12345-0@lo:101: 00010000:00010000:0.0:1787836366.585146:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836366.585163:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab73c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.585190:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.585201:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.585229:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030c00, rc 0) 00000100:00100000:0.0:1787836366.586512:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193136384:12345-0@lo:101: Request processed in 1374us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836366.586525:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787836366.586591:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193136384:0@lo:101: 00010000:00010000:0.0:1787836366.586612:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.586625:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836366.586701:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193136512:0@lo:501: 00000100:00100000:0.0:1787836366.586738:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.590976:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.591729:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193136512 00000100:00100000:3.0:1787836366.591741:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193136512 00000100:00100000:3.0:1787836366.591843:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787836366.591864:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193136512:12345-0@lo:501: 00000100:00100000:3.0:1787836366.592294:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193136512:12345-0@lo:501: Request processed in 433us (5554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.592303:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787836366.596780:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193136512:0@lo:501: 00000100:00100000:2.0:1787836366.597559:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193136640:0@lo:503: 00000100:00100000:2.0:1787836366.597636:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836366.600190:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e565ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787836366.600246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193136640 00000100:00100000:2.0:1787836366.600255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193136640 00000100:00100000:2.0:1787836366.600316:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787836366.600326:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193136640:12345-0@lo:503: 00000100:00100000:2.0:1787836366.600755:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193136640:12345-0@lo:503: Request processed in 428us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836366.600764:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787836366.600849:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193136640:0@lo:503: 00000100:00100000:2.0:1787836366.601107:0:7901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7901:1874682193136768:0@lo:502: 00000100:00100000:2.0:1787836366.601155:0:7901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836366.601178:0:7901:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d85836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836366.605427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193136768 00000100:00100000:0.0:1787836366.605444:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193136768 00000100:00100000:2.0:1787836366.606087:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787836366.606099:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7901:x1874682193136768:12345-0@lo:502: 00000100:00100000:2.0:1787836366.606556:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7901:x1874682193136768:12345-0@lo:502: Request processed in 459us (5399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836366.606565:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787836366.606643:0:7901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7901:1874682193136768:0@lo:502: 00000100:00100000:2.0:1787836366.606717:0:7901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7901:1874682193136896:0@lo:502: 00000100:00100000:2.0:1787836366.606765:0:7901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836366.606790:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193136896 00000100:00100000:2.0:1787836366.606796:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193136896 00000100:00100000:2.0:1787836366.606820:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787836366.606825:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7901:x1874682193136896:12345-0@lo:502: 00000100:00100000:2.0:1787836366.606955:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:7901:x1874682193136896:12345-0@lo:502: Request processed in 129us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836366.606963:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787836366.607003:0:7901:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d85836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836366.607018:0:7901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7901:1874682193136896:0@lo:502: 00000040:00080000:2.0:1787836366.607039:0:7901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787836366.607139:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787836366.607160:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787836366.607171:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836366.607183:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836366.607200:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787836366.607203:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787836366.607206:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787836366.607233:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836366.607240:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836366.607249:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836366.607261:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137024:0@lo:101: 00000100:00100000:2.0:1787836366.607302:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836366.607330:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d85836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.608039:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193137024 00000100:00100000:3.0:1787836366.608048:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193137024 00000100:00100000:3.0:1787836366.608110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787836366.608118:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193137024:12345-0@lo:101: 00010000:00010000:3.0:1787836366.608131:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836366.608148:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab73d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.608175:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.608186:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.608196:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152be00, rc 0) 00000100:00100000:3.0:1787836366.608255:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193137024:12345-0@lo:101: Request processed in 138us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.608262:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787836366.608313:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137024:0@lo:101: 00010000:00010000:3.0:1787836366.608709:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.608721:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836366.608803:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137152:0@lo:501: 00000100:00100000:3.0:1787836366.608838:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.608862:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e951cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.608879:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193137152 00000100:00100000:3.0:1787836366.608883:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193137152 00000100:00100000:3.0:1787836366.609662:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787836366.609684:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193137152:12345-0@lo:501: 00000100:00100000:3.0:1787836366.611124:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193137152:12345-0@lo:501: Request processed in 1439us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.611135:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787836366.611796:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137152:0@lo:501: 00000100:00100000:0.0:1787836366.611859:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137280:0@lo:503: 00000100:00100000:0.0:1787836366.612024:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.612089:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.612216:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193137280 00000100:00100000:3.0:1787836366.612224:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193137280 00000100:00100000:3.0:1787836366.612282:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787836366.612290:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193137280:12345-0@lo:503: 00000100:00100000:3.0:1787836366.613030:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193137280:12345-0@lo:503: Request processed in 737us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.613040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787836366.613640:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137280:0@lo:503: 00000100:00100000:0.0:1787836366.613979:0:7902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7902:1874682193137408:0@lo:502: 00000100:00100000:0.0:1787836366.614049:0:7902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.614105:0:7902:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787836366.614205:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193137408 00000100:00100000:1.0:1787836366.614211:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193137408 00000100:00100000:1.0:1787836366.614263:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787836366.614279:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:7902:x1874682193137408:12345-0@lo:502: 00000100:00100000:1.0:1787836366.614544:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:7902:x1874682193137408:12345-0@lo:502: Request processed in 273us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836366.614552:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787836366.614604:0:7902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7902:1874682193137408:0@lo:502: 00000020:01000000:1.0:1787836366.614630:0:7902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836366.614644:0:7902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836366.614647:0:7902:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787836366.614652:0:7902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787836366.614654:0:7902:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787836366.614670:0:7902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7902:1874682193137536:0@lo:502: 00000100:00100000:1.0:1787836366.614715:0:7902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836366.614732:0:7902:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec300 going to sleep for 11 seconds 00000100:00100000:0.0:1787836366.615044:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193137536 00000100:00100000:0.0:1787836366.615049:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193137536 00000100:00100000:0.0:1787836366.615112:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787836366.615120:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:7902:x1874682193137536:12345-0@lo:502: 00000100:00100000:0.0:1787836366.615298:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:7902:x1874682193137536:12345-0@lo:502: Request processed in 179us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836366.615305:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787836366.615687:0:7902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7902:1874682193137536:0@lo:502: 00000020:01000000:1.0:1787836366.615719:0:7902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836366.615726:0:7902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836366.615728:0:7902:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787836366.615734:0:7902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787836366.615901:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787836366.615999:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787836366.616012:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.616023:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836366.616034:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787836366.616036:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3ce1d0800 from 30 10000000:01000000:0.0:1787836366.616039:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787836366.616098:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.616106:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.616115:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836366.616133:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137664:0@lo:101: 00000100:00100000:0.0:1787836366.616171:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.616200:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c336aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836366.616257:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193137664 00000100:00100000:1.0:1787836366.616262:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193137664 00000100:00100000:1.0:1787836366.616305:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787836366.616312:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193137664:12345-0@lo:101: 00010000:00010000:1.0:1787836366.616320:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836366.616332:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab73e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.616355:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.616364:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.616373:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c13a1000, rc 0) 00000100:00100000:1.0:1787836366.616409:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193137664:12345-0@lo:101: Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836366.616415:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787836366.616458:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137664:0@lo:101: 00010000:00010000:1.0:1787836366.616471:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.616480:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836366.616527:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137792:0@lo:501: 00000100:00100000:1.0:1787836366.616551:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836366.616562:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec480 going to sleep for 11 seconds 00000100:00100000:1.0:1787836366.616573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193137792 00000100:00100000:1.0:1787836366.616576:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193137792 00000100:00100000:1.0:1787836366.616593:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787836366.616598:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193137792:12345-0@lo:501: 00000100:00100000:1.0:1787836366.616809:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193137792:12345-0@lo:501: Request processed in 209us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836366.616816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787836366.616844:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137792:0@lo:501: 00000100:00100000:1.0:1787836366.616872:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137920:0@lo:503: 00000100:00100000:1.0:1787836366.616905:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.617087:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193137920 00000100:00100000:0.0:1787836366.617092:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193137920 00000100:00100000:0.0:1787836366.617119:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787836366.617125:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193137920:12345-0@lo:503: 00000100:00100000:0.0:1787836366.617335:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193137920:12345-0@lo:503: Request processed in 210us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836366.617341:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787836366.618230:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec480 going to sleep for 11 seconds 00000100:00100000:1.0:1787836366.618343:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193137920:0@lo:503: 00000100:00100000:0.0:1787836366.620464:0:7903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7903:1874682193138048:0@lo:502: 00000100:00100000:0.0:1787836366.620563:0:7903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.620646:0:7903:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c336aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836366.620697:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193138048 00000100:00100000:1.0:1787836366.620705:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193138048 00000100:00100000:1.0:1787836366.620800:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787836366.620811:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:7903:x1874682193138048:12345-0@lo:502: 00000100:00100000:1.0:1787836366.621227:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:7903:x1874682193138048:12345-0@lo:502: Request processed in 416us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836366.621314:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787836366.621455:0:7903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7903:1874682193138048:0@lo:502: 00000100:00100000:0.0:1787836366.621526:0:7903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7903:1874682193138176:0@lo:502: 00000100:00100000:0.0:1787836366.621569:0:7903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.621604:0:7903:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1912480 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.621657:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193138176 00000100:00100000:3.0:1787836366.621663:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193138176 00000100:00100000:3.0:1787836366.621704:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787836366.621713:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:7903:x1874682193138176:12345-0@lo:502: 00000100:00100000:3.0:1787836366.621899:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:7903:x1874682193138176:12345-0@lo:502: Request processed in 188us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.621906:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787836366.621988:0:7903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7903:1874682193138176:0@lo:502: 00000040:00080000:0.0:1787836366.622009:0:7903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787836366.622175:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787836366.622204:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787836366.622214:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.622224:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836366.622233:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787836366.622235:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e3ce1d0800 from 5 10000000:01000000:3.0:1787836366.622239:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787836366.622387:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.622396:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.622406:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836366.622433:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138304:0@lo:101: 00000100:00100000:3.0:1787836366.622470:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.622500:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1d56300 going to sleep for 11 seconds 00000100:00100000:0.0:1787836366.622553:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193138304 00000100:00100000:0.0:1787836366.622558:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193138304 00000100:00100000:0.0:1787836366.622633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787836366.622641:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193138304:12345-0@lo:101: 00010000:00010000:0.0:1787836366.622651:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836366.622664:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0030a00/0x966835ea68ab73fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab73f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.622687:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0030a00/0x966835ea68ab73fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab73f3 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.622698:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0030a00/0x966835ea68ab73fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab73f3 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.622718:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030a00, rc 0) 00000100:00100000:0.0:1787836366.622767:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193138304:12345-0@lo:101: Request processed in 126us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836366.622773:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787836366.622847:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138304:0@lo:101: 00010000:00010000:3.0:1787836366.622860:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.622869:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836366.622913:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138432:0@lo:256: 00000100:00100000:3.0:1787836366.622948:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.622972:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1d56300 going to sleep for 11 seconds 00000100:00100000:1.0:1787836366.623025:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193138432 00000100:00100000:1.0:1787836366.623029:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193138432 00000100:00100000:1.0:1787836366.623083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787836366.623092:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193138432:12345-0@lo:256: 20000000:01000000:1.0:1787836366.623106:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787836366.623124:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787836366.623127:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787836366.623216:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193138432:12345-0@lo:256: Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836366.623223:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787836366.623495:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138432:0@lo:256: 10000000:01000000:0.0:1787836366.623540:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787836366.623547:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.623555:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836366.623564:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787836366.623567:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787836366.623569:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787836366.623592:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.623599:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836366.623607:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836366.623620:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138560:0@lo:101: 00000100:00100000:0.0:1787836366.623648:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.623775:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1912a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.623814:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193138560 00000100:00100000:3.0:1787836366.623819:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193138560 00000100:00100000:3.0:1787836366.623878:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787836366.623887:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193138560:12345-0@lo:101: 00010000:00010000:3.0:1787836366.623895:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836366.623920:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7401 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.623940:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7401 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.623949:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7401 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836366.623957:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad800, rc 0) 00000100:00100000:3.0:1787836366.624039:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193138560:12345-0@lo:101: Request processed in 153us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.624046:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787836366.624168:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b803c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138560:0@lo:101: 00010000:00010000:2.0:1787836366.624181:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836366.624189:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836366.624367:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138688:0@lo:501: 00000100:00100000:2.0:1787836366.624395:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836366.624451:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.624480:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193138688 00000100:00100000:3.0:1787836366.624485:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193138688 00000100:00100000:3.0:1787836366.624514:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787836366.624521:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193138688:12345-0@lo:501: 00000100:00100000:3.0:1787836366.624741:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193138688:12345-0@lo:501: Request processed in 220us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.624748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787836366.624779:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138688:0@lo:501: 00000100:00100000:3.0:1787836366.624819:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138816:0@lo:503: 00000100:00100000:3.0:1787836366.624855:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.624868:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1d56c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.624880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193138816 00000100:00100000:3.0:1787836366.624883:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193138816 00000100:00100000:3.0:1787836366.624900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787836366.624905:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193138816:12345-0@lo:503: 00000100:00100000:3.0:1787836366.627695:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193138816:12345-0@lo:503: Request processed in 2778us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.627711:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787836366.628720:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193138816:0@lo:503: 00000100:00100000:0.0:1787836366.633567:0:7906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b82d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7906:1874682193138944:0@lo:502: 00000100:00100000:0.0:1787836366.633666:0:7906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.633999:0:7906:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1912300 going to sleep for 11 seconds 00000100:00100000:2.0:1787836366.639485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193138944 00000100:00100000:2.0:1787836366.639498:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193138944 00000100:00100000:2.0:1787836366.639598:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787836366.639618:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:7906:x1874682193138944:12345-0@lo:502: 00000100:00100000:2.0:1787836366.639990:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:7906:x1874682193138944:12345-0@lo:502: Request processed in 373us (6323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836366.639998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787836366.641093:0:7906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b82d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7906:1874682193138944:0@lo:502: 00000020:01000000:3.0:1787836366.641137:0:7906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787836366.641145:0:7906:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787836366.641154:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836366.641156:0:7906:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787836366.641161:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787836366.641166:0:7906:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:3.0:1787836366.641192:0:7906:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787836366.641195:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787836366.641227:0:7906:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98e2c1803490) 00000020:00000080:3.0:1787836366.641252:0:7906:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787836366.641259:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787836366.641361:0:7906:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787836366.641368:0:7906:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787836366.641377:0:7906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab7416 00010000:00080000:3.0:1787836366.641411:0:7906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e3f5ae5000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1787836366.641659:0:7906:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787836366.642112:0:7906:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787836366.642126:0:7906:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787836366.642663:0:7906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787836366.642886:0:7906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787836366.642943:0:7906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787836366.643005:0:7906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787836366.646470:0:7908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787836366.646478:0:7908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787836366.648650:0:7906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787836366.648666:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787836366.648702:0:7906:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787836366.648726:0:7906:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab741d 00000100:00080000:0.0:1787836366.648736:0:7906:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787836366.648742:0:7906:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e3f5ae5000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1787836366.648777:0:7906:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3d3b812c0 x1874682193139072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787836366.648808:0:7906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787836366.649215:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193139072:0@lo:8: 00000100:00100000:2.0:1787836366.649299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787836366.650184:0:7906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787836366.650191:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836366.650194:0:7906:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787836366.650198:0:7906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787836366.650202:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836366.650204:0:7906:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787836366.650207:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787836366.650209:0:7906:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787836366.652383:0:7906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7906:1874682193139200:0@lo:502: 00000100:00100000:0.0:1787836366.652499:0:7906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.652556:0:7906:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c19123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836366.652581:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193139200 00000100:00100000:1.0:1787836366.652594:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193139200 00000100:00100000:1.0:1787836366.652662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787836366.652674:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:7906:x1874682193139200:12345-0@lo:502: 00000100:00100000:3.0:1787836366.652818:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193139072 00000100:00100000:3.0:1787836366.652823:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193139072 00000100:00100000:3.0:1787836366.652847:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787836366.652853:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874682193139072:12345-0@lo:8: 00010000:00080000:3.0:1787836366.652878:0:6692:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1787836366.652911:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab7424 00002000:00100000:3.0:1787836366.652927:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98e3fabd0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113961 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787836366.652933:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787836366.652938:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787836366.653103:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787836366.653148:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:7906:x1874682193139200:12345-0@lo:502: Request processed in 475us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836366.653156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787836366.653318:0:7906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:7906:1874682193139200:0@lo:502: 00002000:00080000:3.0:1787836366.653327:0:6692:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000020:01000000:1.0:1787836366.653356:0:7906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:3.0:1787836366.653358:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98e3fabd7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787836366.653409:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874682193139072:12345-0@lo:8: Request processed in 555us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.653418:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:1.0:1787836366.653439:0:7906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1787836366.653440:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193139328:0@lo:400: 00000020:00000080:1.0:1787836366.653445:0:7906:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787836366.653453:0:7906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1787836366.653482:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.653511:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787836366.653518:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193139456:0@lo:400: 00000020:01000000:1.0:1787836366.653530:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:3.0:1787836366.653541:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787836366.653556:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787836366.653568:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836366.653573:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193139584:0@lo:400: 00010000:00010000:1.0:1787836366.653592:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836366.653603:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787836366.653606:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e3c7faced8 from 1 00000100:00100000:3.0:1787836366.653610:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787836366.653612:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1787836366.653629:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787836366.653636:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193139712:0@lo:400: 00010000:00010000:1.0:1787836366.653641:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.653651:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836366.653661:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787836366.653665:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836366.653683:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193139840:0@lo:101: 00000100:00100000:3.0:1787836366.653690:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193139584 00000100:00100000:3.0:1787836366.653696:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193139584 00000100:00100000:1.0:1787836366.653722:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.653729:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787836366.653738:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193139584:12345-0@lo:400: 00000100:00100000:1.0:1787836366.653761:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec240 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.653784:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193139584:12345-0@lo:400: Request processed in 48us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836366.653786:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193139840 00000100:00100000:1.0:1787836366.653792:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193139840 00000100:00100000:3.0:1787836366.653796:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787836366.653818:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193139328 00000100:00100000:3.0:1787836366.653821:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193139328 00000100:00100000:3.0:1787836366.653839:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193139456 00000100:00100000:3.0:1787836366.653842:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193139456 00000100:00100000:3.0:1787836366.653851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193139712 00000100:00100000:3.0:1787836366.653854:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193139712 00000100:00100000:3.0:1787836366.653864:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787836366.653870:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193139328:12345-0@lo:400: 00000100:00100000:3.0:1787836366.653909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193139328:12345-0@lo:400: Request processed in 39us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.653915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787836366.653925:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787836366.653931:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193139456:12345-0@lo:400: 00000100:00100000:3.0:1787836366.653957:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193139456:12345-0@lo:400: Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.653963:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787836366.653974:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787836366.653987:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193139712:12345-0@lo:400: 00000100:00100000:3.0:1787836366.654014:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193139712:12345-0@lo:400: Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.654019:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787836366.654079:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8da40 x1874682193139712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.654091:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193139712:0@lo:400: 00010000:00080000:3.0:1787836366.654103:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8de00 x1874682193139584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.654110:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193139584:0@lo:400: 00010000:00080000:3.0:1787836366.654134:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8ed00 x1874682193139456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.654143:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193139456:0@lo:400: 00010000:00080000:3.0:1787836366.654152:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8d2c0 x1874682193139328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.654158:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193139328:0@lo:400: 00010000:00080000:3.0:1787836366.654190:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b812c0 x1874682193139072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787836376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836366.654198:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787836366.654204:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787836366.654211:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787836366.654216:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787836366.654218:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3f5ae5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787836366.654234:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787836366.654246:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193139072:0@lo:8: 00000004:00080000:3.0:1787836366.654288:0:7908:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787836366.654335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787836366.654344:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193139840:12345-0@lo:101: 00010000:00010000:1.0:1787836366.654354:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1787836366.654408:0:7908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 215087348803ns, next at 0ns, rc = 0 00010000:00010000:1.0:1787836366.654450:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab742b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.654476:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab742b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.654500:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab742b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.654510:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c13a0a00, rc 0) 00000100:00100000:1.0:1787836366.654550:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193139840:12345-0@lo:101: Request processed in 208us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836366.654557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787836366.654622:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193139840:0@lo:101: 00010000:00010000:1.0:1787836366.654639:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.654648:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836366.654738:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193139968:0@lo:501: 00000100:00100000:1.0:1787836366.654771:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836366.654801:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836366.660518:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193139968 00000100:00100000:0.0:1787836366.660536:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193139968 00000100:00100000:0.0:1787836366.660629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787836366.660642:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193139968:12345-0@lo:501: 00000100:00100000:0.0:1787836366.660972:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193139968:12345-0@lo:501: Request processed in 333us (6201us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787836366.660982:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787836366.661254:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193139968:0@lo:501: 10000000:01000000:1.0:1787836366.661312:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787836366.661323:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836366.661334:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836366.749119:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787836366.785092:0:7909:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787836366.785131:0:7909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7909:1874682193140224:0@lo:7: 00000100:00100000:2.0:1787836366.785210:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836366.785264:0:7909:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583300 going to sleep for 11 seconds 00000100:00100000:0.0:1787836366.785336:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193140096:0@lo:13: 00000100:00100000:0.0:1787836366.785376:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836366.785470:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193140096 00000100:00100000:2.0:1787836366.785479:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193140096 00000100:00100000:2.0:1787836366.785549:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787836366.785559:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193140096:12345-0@lo:13: 00002000:00000024:2.0:1787836366.785591:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787836366.785633:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193140096:12345-0@lo:13: Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836366.785640:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787836366.785697:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787836366.785723:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3ddcb40 x1874682193140096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836366.785742:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193140096:0@lo:13: 00000100:00100000:3.0:1787836366.786510:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193140224 00000100:00100000:3.0:1787836366.786519:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193140224 00000100:00100000:3.0:1787836366.786563:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787836366.786573:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d2180b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7909:x1874682193140224:12345-0@lo:7: 00002000:00080000:3.0:1787836366.791617:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787836366.791626:0:6693:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787836366.792765:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d2180b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7909:x1874682193140224:12345-0@lo:7: Request processed in 6186us (7546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.792779:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787836366.793019:0:7909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3ddda40 x1874682193140224/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787836382 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836366.793036:0:7909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7909:1874682193140224:0@lo:7: 00000004:00080000:0.0:1787836366.793051:0:7909:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787836366.793119:0:7909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7909:1874682193140352:0@lo:5: 00000100:00100000:0.0:1787836366.793163:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836366.793198:0:7909:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c336a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.793303:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193140352 00000100:00100000:3.0:1787836366.793310:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193140352 00000100:00100000:3.0:1787836366.793356:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787836366.793365:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7909:x1874682193140352:12345-0@lo:5: 00002000:00080000:3.0:1787836366.793388:0:6692:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787836366.793391:0:6692:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787836366.794478:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7909:x1874682193140352:12345-0@lo:5: Request processed in 1108us (1308us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787836366.794490:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787836366.795379:0:7909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b83840 x1874682193140352/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787836382 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836366.795400:0:7909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7909:1874682193140352:0@lo:5: 00000004:00080000:1.0:1787836366.795417:0:7909:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787836366.795527:0:7909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7909:1874682193140480:0@lo:700: 00000100:00100000:1.0:1787836366.795580:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836366.795631:0:7909:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651240 going to sleep for 11 seconds 00000100:00100000:3.0:1787836366.795873:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193140480 00000100:00100000:3.0:1787836366.795880:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193140480 00000100:00100000:3.0:1787836366.795942:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836366.795952:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7909:x1874682193140480:12345-0@lo:700: 00000100:00100000:3.0:1787836366.795987:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1874682193140608:0@lo:700: 00000100:00100000:3.0:1787836366.796022:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836366.796052:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1d56240 going to sleep for 11 seconds 00000100:00100000:1.0:1787836366.796222:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193140608 00000100:00100000:1.0:1787836366.796226:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193140608 00000100:00100000:1.0:1787836366.796274:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787836366.796283:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1874682193140608:12345-0@lo:700: 40000000:02000000:3.0:1787836366.825913:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787836366.831943:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1874682193140608:12345-0@lo:700: Request processed in 35649us (35907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.831964:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787836366.832052:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8d2c0 x1874682193140608/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787836382 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836366.832149:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1874682193140608:0@lo:700: 40000000:02000000:1.0:1787836366.832168:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787836366.902635:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787836366.902664:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787836366.902817:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7909:x1874682193140480:12345-0@lo:700: Request processed in 106862us (107230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836366.902830:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787836366.903385:0:7909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3a621c0 x1874682193140480/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787836382 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836366.903398:0:7909:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787836366.903564:0:7909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7909:1874682193140480:0@lo:700: 00000004:02000040:1.0:1787836366.939783:0:7909:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787836366.944054:0:7909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7909:1874682193140736:0@lo:5: 00000100:00100000:1.0:1787836366.944155:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836366.944208:0:7909:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836366.946261:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193140736 00000100:00100000:2.0:1787836366.946283:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193140736 00000100:00100000:2.0:1787836366.946343:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787836366.946353:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7909:x1874682193140736:12345-0@lo:5: 00002000:00080000:0.0:1787836366.954487:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787836366.954510:0:6693:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787836366.964086:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7909:x1874682193140736:12345-0@lo:5: Request processed in 17705us (19902us total) trans 4294967298 rc 0/0 00010000:00080000:2.0:1787836366.964106:0:7909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3a621c0 x1874682193140736/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787836382 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836366.964114:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787836366.964133:0:7909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7909:1874682193140736:0@lo:5: 00000004:00080000:2.0:1787836366.964152:0:7909:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787836367.025568:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836368.047647:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787836368.194254:0:7993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787836368.622819:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193140864:0@lo:13: 00000100:00100000:1.0:1787836368.622898:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836368.623394:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193140864 00000100:00100000:3.0:1787836368.623403:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193140864 00000100:00100000:3.0:1787836368.623483:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787836368.623493:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193140864:12345-0@lo:13: 00002000:00000024:3.0:1787836368.623526:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836368.623584:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193140864:12345-0@lo:13: Request processed in 93us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836368.623591:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787836368.623674:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8de00 x1874682193140864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836368.623694:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193140864:0@lo:13: 00000100:00080000:0.0:1787836368.623757:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787836369.080453:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836370.094662:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836371.118876:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836371.694782:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193140992:0@lo:400: 00000100:00100000:0.0:1787836371.694888:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836371.694958:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193141504:0@lo:400: 00000100:00100000:0.0:1787836371.694995:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836371.695028:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787836371.695034:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193141120:0@lo:400: 00000100:00100000:0.0:1787836371.695088:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836371.695119:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193141632:0@lo:400: 00000100:00100000:0.0:1787836371.695148:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836371.695457:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193141504 00000100:00100000:0.0:1787836371.695464:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193141504 00000100:00100000:0.0:1787836371.695515:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193141120 00000100:00100000:0.0:1787836371.695518:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193141120 00000100:00100000:0.0:1787836371.695533:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787836371.695540:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193141504:12345-0@lo:400: 00000100:00100000:0.0:1787836371.695592:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193141504:12345-0@lo:400: Request processed in 52us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836371.695600:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787836371.695618:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787836371.695626:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193141120:12345-0@lo:400: 00000100:00100000:0.0:1787836371.695655:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193141120:12345-0@lo:400: Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836371.695661:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787836371.695775:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193141248:0@lo:400: 00000100:00100000:3.0:1787836371.695812:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836371.695828:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787836371.695834:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193141376:0@lo:400: 00000100:00100000:3.0:1787836371.695854:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836371.696037:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193140992 00000100:00100000:1.0:1787836371.696042:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193140992 00000100:00100000:1.0:1787836371.696098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787836371.696106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193140992:12345-0@lo:400: 00000100:00100000:1.0:1787836371.696155:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193140992:12345-0@lo:400: Request processed in 51us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836371.696160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787836371.696319:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193141248 00000100:00100000:0.0:1787836371.696324:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193141248 00000100:00100000:0.0:1787836371.696350:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787836371.696357:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193141248:12345-0@lo:400: 00000100:00100000:0.0:1787836371.696396:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193141248:12345-0@lo:400: Request processed in 40us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836371.696412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787836371.696444:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193141632 00000100:00100000:0.0:1787836371.696448:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193141632 00000100:00100000:0.0:1787836371.696477:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193141376 00000100:00100000:0.0:1787836371.696480:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193141376 00000100:00100000:0.0:1787836371.696501:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836371.696509:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193141632:12345-0@lo:400: 00000100:00100000:0.0:1787836371.696546:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193141632:12345-0@lo:400: Request processed in 39us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836371.696554:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836371.696568:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787836371.696575:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193141376:12345-0@lo:400: 00000100:00100000:0.0:1787836371.696604:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193141376:12345-0@lo:400: Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836371.696610:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787836371.696626:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787836371.696631:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787836371.696634:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787836371.698493:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8f480 x1874682193141120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836371.698514:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193141120:0@lo:400: 00010000:00080000:0.0:1787836371.698548:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8de00 x1874682193141632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836371.698559:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193141632:0@lo:400: 00000100:00100000:0.0:1787836371.698573:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193140992:0@lo:400: 00010000:00080000:0.0:1787836371.698603:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8da40 x1874682193141504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836371.698613:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193141504:0@lo:400: 00010000:00080000:0.0:1787836371.699298:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8cf00 x1874682193141376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836371.699310:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193141376:0@lo:400: 00010000:00080000:0.0:1787836371.699328:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8c780 x1874682193141248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836371.699336:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193141248:0@lo:400: 00010000:00010000:1.0:1787836372.144028:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836372.211936:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836372.211969:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193141760:0@lo:13: 00000100:00100000:1.0:1787836372.212052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836372.212146:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193141760 00000100:00100000:1.0:1787836372.212155:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193141760 00000100:00100000:1.0:1787836372.212201:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787836372.212211:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193141760:12345-0@lo:13: 00002000:00000024:1.0:1787836372.212258:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836372.212307:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193141760:12345-0@lo:13: Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836372.212314:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787836372.212359:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3a63840 x1874682193141760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836372.212380:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193141760:0@lo:13: 00000001:00080000:3.0:1787836372.269885:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787836373.178491:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836373.469973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836373.470050:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172145792 00000100:00100000:3.0:1787836373.470081:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172145792 00000100:00100000:3.0:1787836373.470123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:3.0:1787836373.470131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1874682172145792:12345-192.168.203.25@tcp:250: 00010000:00080000:3.0:1787836373.470157:0:5833:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from ca08bc65-fcc3-4057-9765-e4ee8e6d6c49@192.168.203.25@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:3.0:1787836373.470194:0:5833:0:(genops.c:1385:class_connect()) connect: client ca08bc65-fcc3-4057-9765-e4ee8e6d6c49, cookie 0x966835ea68ab7439 00000100:00080000:3.0:1787836373.470342:0:5833:0:(import.c:65:import_set_state_nolock()) ffff98e3ee577000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787836373.470403:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+5:2360:x1874682172145792:12345-192.168.203.25@tcp:250: Request processed in 271us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836373.470411:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:0.0:1787836373.483253:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836373.484519:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172145920 00000100:00100000:1.0:1787836373.484530:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172145920 00000100:00100000:1.0:1787836373.484604:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00100000:1.0:1787836373.484613:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+5:5587:x1874682172145920:12345-192.168.203.25@tcp:101: 00010000:00010000:1.0:1787836373.484628:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836373.484643:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edd53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836373.484669:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836373.484681:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836373.484691:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c13a1e00, rc 0) 00000100:00100000:1.0:1787836373.484754:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+6:5587:x1874682172145920:12345-192.168.203.25@tcp:101: Request processed in 142us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836373.484768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00100000:0.0:1787836373.491993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836373.492099:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172146048 00000100:00100000:3.0:1787836373.492108:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172146048 00000100:00100000:3.0:1787836373.492156:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:3.0:1787836373.492167:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+6:5587:x1874682172146048:12345-192.168.203.25@tcp:501: 00000100:00100000:3.0:1787836373.492444:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+6:5587:x1874682172146048:12345-192.168.203.25@tcp:501: Request processed in 277us (458us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787836373.492452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:0.0:1787836373.495185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836373.495331:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172146176 00000100:00100000:3.0:1787836373.495343:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172146176 00000100:00100000:3.0:1787836373.495393:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:3.0:1787836373.495406:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+6:5587:x1874682172146176:12345-192.168.203.25@tcp:101: 00010000:00010000:3.0:1787836373.495426:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836373.495444:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edd5a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.495477:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.495489:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.495499:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ace00, rc 0) 00000100:00100000:3.0:1787836373.495569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+7:5587:x1874682172146176:12345-192.168.203.25@tcp:101: Request processed in 167us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836373.495590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:0.0:1787836373.498687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836373.498773:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172146304 00000100:00100000:2.0:1787836373.498783:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172146304 00000100:00100000:2.0:1787836373.498837:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:2.0:1787836373.498848:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+7:5587:x1874682172146304:12345-192.168.203.25@tcp:501: 00000100:00100000:2.0:1787836373.499138:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5587:x1874682172146304:12345-192.168.203.25@tcp:501: Request processed in 291us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836373.499147:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:0.0:1787836373.501492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836373.501588:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172146432 00000100:00100000:3.0:1787836373.501597:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172146432 00000100:00100000:3.0:1787836373.501646:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:3.0:1787836373.501655:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5587:x1874682172146432:12345-192.168.203.25@tcp:503: 00000100:00100000:3.0:1787836373.502096:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5587:x1874682172146432:12345-192.168.203.25@tcp:503: Request processed in 440us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836373.502105:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:0.0:1787836373.508536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836373.508677:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172146560 00000100:00100000:1.0:1787836373.508686:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172146560 00000100:00100000:1.0:1787836373.508742:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:1.0:1787836373.508752:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5605:x1874682172146560:12345-192.168.203.25@tcp:502: 00000100:00100000:1.0:1787836373.509117:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5605:x1874682172146560:12345-192.168.203.25@tcp:502: Request processed in 365us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836373.509125:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:0.0:1787836373.542567:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836373.542604:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172146688 00000100:00100000:0.0:1787836373.542613:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172146688 00000100:00100000:0.0:1787836373.542657:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:0.0:1787836373.542667:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5605:x1874682172146688:12345-192.168.203.25@tcp:502: 00000100:00100000:0.0:1787836373.543341:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5605:x1874682172146688:12345-192.168.203.25@tcp:502: Request processed in 673us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836373.543350:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:0.0:1787836373.550828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836373.550923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172146816 00000100:00100000:3.0:1787836373.550934:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172146816 00000100:00100000:3.0:1787836373.550990:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:3.0:1787836373.551001:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5587:x1874682172146816:12345-192.168.203.25@tcp:101: 00010000:00010000:3.0:1787836373.551017:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836373.551035:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ada00/0x966835ea68ab744e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edd84 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.551088:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ada00/0x966835ea68ab744e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd84 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.551185:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ada00/0x966835ea68ab744e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd84 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.551196:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ada00, rc 0) 00000100:00100000:3.0:1787836373.551264:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5587:x1874682172146816:12345-192.168.203.25@tcp:101: Request processed in 265us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836373.551347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:0.0:1787836373.560764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836373.561758:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172146944 00000100:00100000:1.0:1787836373.561774:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172146944 00000100:00100000:1.0:1787836373.561890:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:1.0:1787836373.561901:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5587:x1874682172146944:12345-192.168.203.25@tcp:256: 20000000:01000000:1.0:1787836373.561934:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787836373.561952:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787836373.561957:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787836373.561960:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787836373.561962:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787836373.564674:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5587:x1874682172146944:12345-192.168.203.25@tcp:256: Request processed in 2764us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836373.564735:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:0.0:1787836373.568774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836373.568997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172147072 00000100:00100000:3.0:1787836373.569160:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172147072 00000100:00100000:3.0:1787836373.569241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:3.0:1787836373.569254:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5587:x1874682172147072:12345-192.168.203.25@tcp:101: 00010000:00010000:3.0:1787836373.569273:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836373.569292:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edd8b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.569322:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.569335:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836373.569346:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13aca00, rc 0) 00000100:00100000:3.0:1787836373.569423:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5587:x1874682172147072:12345-192.168.203.25@tcp:101: Request processed in 172us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836373.569432:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:2.0:1787836373.572322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836373.572419:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172147200 00000100:00100000:1.0:1787836373.572429:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172147200 00000100:00100000:1.0:1787836373.572492:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:1.0:1787836373.572504:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5587:x1874682172147200:12345-192.168.203.25@tcp:501: 00000100:00100000:1.0:1787836373.572842:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5587:x1874682172147200:12345-192.168.203.25@tcp:501: Request processed in 339us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836373.572851:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:0.0:1787836373.580700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836373.580799:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172147328 00000100:00100000:3.0:1787836373.580810:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172147328 00000100:00100000:3.0:1787836373.580880:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:3.0:1787836373.580891:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5587:x1874682172147328:12345-192.168.203.25@tcp:503: 00000100:00100000:3.0:1787836373.581664:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5587:x1874682172147328:12345-192.168.203.25@tcp:503: Request processed in 771us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836373.581674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:2.0:1787836373.595346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836373.595902:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172147456 00000100:00100000:0.0:1787836373.595912:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172147456 00000100:00100000:0.0:1787836373.595975:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:0.0:1787836373.595986:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5610:x1874682172147456:12345-192.168.203.25@tcp:502: 00000100:00100000:0.0:1787836373.596312:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5610:x1874682172147456:12345-192.168.203.25@tcp:502: Request processed in 326us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836373.596321:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:2.0:1787836373.602382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836373.602430:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172147584 00000100:00100000:2.0:1787836373.602441:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172147584 00000100:00100000:2.0:1787836373.602630:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:2.0:1787836373.602641:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5610:x1874682172147584:12345-192.168.203.25@tcp:502: 00000100:00100000:2.0:1787836373.602888:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5610:x1874682172147584:12345-192.168.203.25@tcp:502: Request processed in 248us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836373.602897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:3.0:1787836373.610114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836373.610355:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172147712 00000100:00100000:2.0:1787836373.610365:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172147712 00000100:00100000:2.0:1787836373.610456:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:2.0:1787836373.610464:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1874682172147712:12345-192.168.203.25@tcp:38: 00010000:00080000:2.0:1787836373.610502:0:5842:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1787836373.610542:0:5842:0:(genops.c:1385:class_connect()) connect: client 2cd520e4-f240-41e5-b585-08ee5ec96478, cookie 0x966835ea68ab745c 00000004:00100000:2.0:1787836373.610571:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1787836373.610586:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787836373.682573:0:5842:0:(import.c:65:import_set_state_nolock()) ffff98e2c2db7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787836373.682776:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2360:x1874682172147712:12345-192.168.203.25@tcp:38: Request processed in 72310us (72670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836373.682787:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1787836373.743048:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d2181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193141888:0@lo:13: 00000100:00100000:1.0:1787836373.743214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836373.743358:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193141888 00000100:00100000:1.0:1787836373.743366:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193141888 00000100:00080000:0.0:1787836373.743396:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836373.743413:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787836373.743421:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193141888:12345-0@lo:13: 00002000:00000024:1.0:1787836373.744157:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836373.744235:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193141888:12345-0@lo:13: Request processed in 813us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836373.744243:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787836373.744306:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d2181680 x1874682193141888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836373.744331:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d2181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193141888:0@lo:13: 00010000:00010000:1.0:1787836374.190203:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836374.438642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836374.439600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836374.440052:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172147968 00000100:00100000:0.0:1787836374.440087:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172147968 00000100:00100000:0.0:1787836374.440168:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172147840 00000100:00100000:0.0:1787836374.440172:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172147840 00000100:00100000:0.0:1787836374.440190:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1787836374.440200:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d2181680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:5587:x1874682172147968:12345-192.168.203.25@tcp:41: 00000004:00000024:0.0:1787836374.440331:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787836374.440398:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d2181680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:5587:x1874682172147968:12345-192.168.203.25@tcp:41: Request processed in 199us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836374.440407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1787836374.440494:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:0.0:1787836374.440501:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:0:x1874682172147840:12345-192.168.203.25@tcp:41: 00000004:00000024:0.0:1787836374.440511:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787836374.440530:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:0:x1874682172147840:12345-192.168.203.25@tcp:41: Request processed in 30us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836374.440548:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00080000:2.0:1787836374.440613:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836374.444416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836374.445319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172148096 00000100:00100000:3.0:1787836374.445334:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172148096 00000100:00100000:3.0:1787836374.445558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1787836374.445570:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:5587:x1874682172148096:12345-192.168.203.25@tcp:40: 00000100:00100000:3.0:1787836374.445695:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:5587:x1874682172148096:12345-192.168.203.25@tcp:40: Request processed in 127us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836374.445703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1787836374.456784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836374.457145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836374.457763:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836374.457810:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836374.458426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172148480 00000100:00100000:2.0:1787836374.458437:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172148480 00000100:00100000:2.0:1787836374.458493:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:2.0:1787836374.458502:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:5587:x1874682172148480:12345-192.168.203.25@tcp:33: 00000100:00100000:2.0:1787836374.458587:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172148608 00000100:00100000:2.0:1787836374.458591:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172148608 00000100:00100000:2.0:1787836374.458616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:2.0:1787836374.458623:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2361:x1874682172148608:12345-192.168.203.25@tcp:400: 00000100:00100000:2.0:1787836374.458681:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2361:x1874682172148608:12345-192.168.203.25@tcp:400: Request processed in 58us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836374.458688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:0.0:1787836374.459038:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172148224 00000100:00100000:0.0:1787836374.459045:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172148224 00000100:00100000:0.0:1787836374.459093:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172148352 00000100:00100000:0.0:1787836374.459097:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172148352 00000100:00100000:0.0:1787836374.459113:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:0.0:1787836374.459119:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874682172148224:12345-192.168.203.25@tcp:8: 00010000:00080000:0.0:1787836374.459144:0:6692:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:0.0:1787836374.459191:0:6692:0:(genops.c:1385:class_connect()) connect: client 2cd520e4-f240-41e5-b585-08ee5ec96478, cookie 0x966835ea68ab7463 00002000:00100000:0.0:1787836374.459201:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2cd520e4-f240-41e5-b585-08ee5ec96478/ffff98e401e6f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787836374.459224:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787836374.459632:0:6692:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787836374.459671:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98e401e68000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787836374.459717:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2360:x1874682172148224:12345-192.168.203.25@tcp:8: Request processed in 597us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836374.459726:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:0.0:1787836374.459746:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:0.0:1787836374.459751:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874682172148352:12345-192.168.203.25@tcp:8: 00010000:00080000:0.0:1787836374.459788:0:6692:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:0.0:1787836374.459806:0:6692:0:(genops.c:1385:class_connect()) connect: client 2cd520e4-f240-41e5-b585-08ee5ec96478, cookie 0x966835ea68ab746a 00002000:00100000:0.0:1787836374.459812:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2cd520e4-f240-41e5-b585-08ee5ec96478/ffff98e401e6d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787836374.459827:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787836374.460167:0:6692:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787836374.460197:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98e401e6e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787836374.460244:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2360:x1874682172148352:12345-192.168.203.25@tcp:8: Request processed in 491us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836374.460252:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000004:00080000:3.0:1787836374.489371:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30804us 00000004:00200000:3.0:1787836374.512454:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787836374.512633:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:5587:x1874682172148480:12345-192.168.203.25@tcp:33: Request processed in 54126us (54877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836374.512646:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:2.0:1787836374.689780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836374.689940:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172148736 00000100:00100000:1.0:1787836374.689950:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172148736 00000100:00100000:1.0:1787836374.690040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1787836374.690050:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:5627:x1874682172148736:12345-192.168.203.25@tcp:101: 00010000:00010000:1.0:1787836374.690112:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836374.690179:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c13a0600/0x966835ea68ab7471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000eddb5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836374.690258:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c13a0c00/0x966835ea68ab7478 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836374.690273:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c13a0c00/0x966835ea68ab7478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836374.690286:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c13a0c00/0x966835ea68ab7478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836374.690512:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787836374.690516:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836374.690595:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c13a0c00/0x966835ea68ab7478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836374.690622:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c13a0600/0x966835ea68ab7471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddb5 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836374.690642:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c13a0c00/0x966835ea68ab7478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddb5 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836374.690651:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:1.0:1787836374.690661:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836374.690666:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c13a0c00, rc 0) 00000100:00100000:1.0:1787836374.690739:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:5627:x1874682172148736:12345-192.168.203.25@tcp:101: Request processed in 689us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836374.690747:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00010000:00010000:1.0:1787836375.217743:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787836375.821925:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00010000:00010000:2.0:1787836376.238613:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836376.815811:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193142016:0@lo:400: 00000100:00100000:1.0:1787836376.815888:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193142144:0@lo:400: 00000100:00100000:0.0:1787836376.815907:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836376.816026:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836376.816123:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193142272:0@lo:400: 00000100:00100000:0.0:1787836376.816181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836376.816233:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836376.816241:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193142400:0@lo:400: 00000100:00100000:1.0:1787836376.816256:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193142656:0@lo:400: 00000100:00100000:0.0:1787836376.816271:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836376.816299:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836376.816322:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193142400 00000100:00100000:0.0:1787836376.816329:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193142400 00000100:00100000:1.0:1787836376.816336:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836376.816344:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193142528:0@lo:400: 00000100:00100000:1.0:1787836376.816371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836376.816388:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193142656 00000100:00100000:0.0:1787836376.816392:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193142656 00000100:00100000:0.0:1787836376.816414:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787836376.816422:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193142016 00000100:00100000:0.0:1787836376.816425:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193142400:12345-0@lo:400: 00000100:00100000:2.0:1787836376.816430:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193142016 00000100:00100000:2.0:1787836376.816465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787836376.816475:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193142016:12345-0@lo:400: 00000100:00100000:0.0:1787836376.816488:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193142400:12345-0@lo:400: Request processed in 64us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836376.816496:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787836376.816511:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787836376.816517:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193142656:12345-0@lo:400: 00000100:00100000:0.0:1787836376.816548:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193142656:12345-0@lo:400: Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836376.816553:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787836376.816589:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fae81e00 x1874682193142400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836376.816622:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193142400:0@lo:400: 00000100:00100000:2.0:1787836376.816641:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193142016:12345-0@lo:400: Request processed in 167us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836376.816649:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787836376.816677:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193142016:0@lo:400: 00010000:00080000:1.0:1787836376.819321:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fae830c0 x1874682193142656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836376.819339:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787836376.819362:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193142656:0@lo:400: 00000100:00080000:1.0:1787836376.819426:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836376.819749:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193142144 00000100:00100000:2.0:1787836376.819757:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193142144 00000100:00100000:2.0:1787836376.819798:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193142272 00000100:00100000:2.0:1787836376.819800:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193142272 00000100:00100000:2.0:1787836376.819815:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193142528 00000100:00100000:2.0:1787836376.819816:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193142528 00000100:00100000:2.0:1787836376.819830:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787836376.819837:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193142144:12345-0@lo:400: 00000100:00100000:2.0:1787836376.819913:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193142144:12345-0@lo:400: Request processed in 76us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836376.819921:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787836376.819938:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787836376.819944:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193142272:12345-0@lo:400: 00000100:00100000:2.0:1787836376.819979:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193142272:12345-0@lo:400: Request processed in 35us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836376.819984:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787836376.819995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787836376.820000:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193142528:12345-0@lo:400: 00000100:00100000:2.0:1787836376.820027:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193142528:12345-0@lo:400: Request processed in 27us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836376.820049:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787836376.820492:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193142272:0@lo:400: 00000100:00100000:3.0:1787836376.820541:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193142528:0@lo:400: 00000100:00100000:3.0:1787836376.820553:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193142144:0@lo:400: 00000100:00080000:1.0:1787836376.820768:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787836376.820771:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836376.912964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836376.913094:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172148864 00000100:00100000:0.0:1787836376.913104:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172148864 00000100:00100000:0.0:1787836376.913300:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:0.0:1787836376.913310:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:5680:x1874682172148864:12345-192.168.203.25@tcp:41: 00000004:00000024:0.0:1787836376.913361:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787836376.913426:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:5680:x1874682172148864:12345-192.168.203.25@tcp:41: Request processed in 118us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836376.913434:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00080000:1.0:1787836376.913495:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836376.928535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836376.928834:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172148992 00000100:00100000:1.0:1787836376.928845:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172148992 00000100:00100000:1.0:1787836376.928930:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:1.0:1787836376.928940:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2cd520e4-f240-41e5-b585-08ee5ec96478+5:5680:x1874682172148992:12345-192.168.203.25@tcp:13: 00002000:00000024:1.0:1787836376.928980:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836376.929050:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2cd520e4-f240-41e5-b585-08ee5ec96478+5:5680:x1874682172148992:12345-192.168.203.25@tcp:13: Request processed in 111us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836376.929101:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00080000:2.0:1787836376.933375:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836376.933729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836376.934086:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172149120 00000100:00100000:1.0:1787836376.934097:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172149120 00000100:00100000:1.0:1787836376.934176:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1787836376.934186:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2cd520e4-f240-41e5-b585-08ee5ec96478+6:5680:x1874682172149120:12345-192.168.203.25@tcp:13: 00002000:00000024:1.0:1787836376.934232:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836376.934293:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2cd520e4-f240-41e5-b585-08ee5ec96478+6:5680:x1874682172149120:12345-192.168.203.25@tcp:13: Request processed in 108us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836376.934300:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00080000:3.0:1787836376.934750:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787836377.263190:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836377.326240:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836377.326274:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193142784:0@lo:13: 00000100:00100000:1.0:1787836377.326380:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836377.326473:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193142784 00000100:00100000:1.0:1787836377.326480:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193142784 00000100:00100000:1.0:1787836377.326527:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787836377.326536:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193142784:12345-0@lo:13: 00002000:00000024:1.0:1787836377.326558:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836377.326604:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193142784:12345-0@lo:13: Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836377.326612:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787836377.326660:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c198e580 x1874682193142784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836377.326679:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193142784:0@lo:13: 00010000:00010000:1.0:1787836378.286328:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836378.864353:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836378.864391:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193142912:0@lo:13: 00000100:00100000:0.0:1787836378.864462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836378.864555:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193142912 00000100:00100000:0.0:1787836378.864563:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193142912 00000100:00100000:0.0:1787836378.864616:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787836378.864625:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193142912:12345-0@lo:13: 00002000:00000024:0.0:1787836378.864660:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836378.864702:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193142912:12345-0@lo:13: Request processed in 78us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836378.864709:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787836378.864729:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787836378.864771:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8de00 x1874682193142912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836378.864792:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193142912:0@lo:13: 00000001:00100000:0.0:1787836378.915591:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000001:00100000:0.0:1787836378.925803:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000001:02000400:1.0:1787836379.208332:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787836379.310867:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836379.755438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836379.755527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836379.755598:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836379.755646:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836379.755676:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172149632 00000100:00100000:0.0:1787836379.755685:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172149632 00000100:00100000:0.0:1787836379.755759:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172149504 00000100:00100000:0.0:1787836379.755762:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172149504 00000100:00100000:0.0:1787836379.755782:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:0.0:1787836379.755791:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172149632:12345-192.168.203.25@tcp:400: 00000100:00100000:0.0:1787836379.755859:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172149632:12345-192.168.203.25@tcp:400: Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836379.755866:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:0.0:1787836379.755883:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:0.0:1787836379.755889:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172149504:12345-192.168.203.25@tcp:400: 00000100:00100000:0.0:1787836379.755913:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172149504:12345-192.168.203.25@tcp:400: Request processed in 24us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836379.755919:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00080000:0.0:1787836379.755934:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787836379.755938:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836379.756989:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172149248 00000100:00100000:2.0:1787836379.757002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172149248 00000100:00100000:2.0:1787836379.757102:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:2.0:1787836379.757110:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2362:x1874682172149248:12345-192.168.203.25@tcp:400: 00000100:00100000:2.0:1787836379.757156:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2362:x1874682172149248:12345-192.168.203.25@tcp:400: Request processed in 48us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836379.757163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:1.0:1787836379.761927:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172149376 00000100:00100000:1.0:1787836379.761944:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172149376 00000100:00100000:1.0:1787836379.762134:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1787836379.762148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172149376:12345-192.168.203.25@tcp:400: 00000100:00100000:1.0:1787836379.762250:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172149376:12345-192.168.203.25@tcp:400: Request processed in 107us (6884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836379.762258:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00080000:0.0:1787836379.767200:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787836380.340916:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836381.362476:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836381.934299:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193143040:0@lo:400: 00000100:00100000:3.0:1787836381.934383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836381.934430:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193143552:0@lo:400: 00000100:00100000:3.0:1787836381.934471:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836381.934503:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193143552 00000100:00100000:3.0:1787836381.934508:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787836381.934511:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193143552 00000100:00100000:3.0:1787836381.934524:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193143168:0@lo:400: 00000100:00100000:0.0:1787836381.934569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787836381.934579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193143552:12345-0@lo:400: 00000100:00100000:0.0:1787836381.934634:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193143552:12345-0@lo:400: Request processed in 56us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836381.934641:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787836381.934663:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836381.934986:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836381.935020:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193143680:0@lo:400: 00000100:00100000:0.0:1787836381.935201:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193143168 00000100:00100000:0.0:1787836381.935206:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193143168 00000100:00100000:0.0:1787836381.935239:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787836381.935247:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836381.935250:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193143168:12345-0@lo:400: 00000100:00100000:0.0:1787836381.935288:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193143168:12345-0@lo:400: Request processed in 42us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836381.935294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787836381.935412:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193143552:0@lo:400: 00000100:00100000:3.0:1787836381.935862:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193143168:0@lo:400: 00000100:00100000:3.0:1787836381.935898:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193143296:0@lo:400: 00000100:00100000:3.0:1787836381.935933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836381.935965:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787836381.935971:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193143424:0@lo:400: 00000100:00100000:3.0:1787836381.935994:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836381.936023:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193143040 00000100:00100000:3.0:1787836381.936027:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193143040 00000100:00100000:3.0:1787836381.936081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787836381.936090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193143040:12345-0@lo:400: 00000100:00100000:3.0:1787836381.936129:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193143040:12345-0@lo:400: Request processed in 40us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836381.936135:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787836381.936176:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193143680 00000100:00100000:3.0:1787836381.936180:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193143680 00000100:00100000:3.0:1787836381.936212:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193143424 00000100:00100000:3.0:1787836381.936215:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193143424 00000100:00100000:3.0:1787836381.936231:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787836381.936238:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193143680:12345-0@lo:400: 00000100:00100000:3.0:1787836381.936285:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193143680:12345-0@lo:400: Request processed in 48us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836381.936305:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787836381.936318:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787836381.936335:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193143424:12345-0@lo:400: 00000100:00100000:3.0:1787836381.936369:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193143424:12345-0@lo:400: Request processed in 46us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836381.936375:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787836381.936415:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8c000 x1874682193143424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836381.936427:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193143424:0@lo:400: 00010000:00080000:3.0:1787836381.937244:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b68f00 x1874682193143680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836381.937256:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193143680:0@lo:400: 00000100:00100000:3.0:1787836381.937267:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193143040:0@lo:400: 00000100:00100000:0.0:1787836381.937456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193143296 00000100:00100000:0.0:1787836381.937462:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193143296 00000100:00100000:0.0:1787836381.937512:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787836381.937522:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193143296:12345-0@lo:400: 00000100:00100000:0.0:1787836381.937582:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193143296:12345-0@lo:400: Request processed in 61us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836381.937589:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787836381.937606:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787836381.937610:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787836381.937612:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787836381.937632:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193143296:0@lo:400: 00010000:00010000:2.0:1787836382.385635:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836382.447345:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193143808:0@lo:13: 00000100:00100000:3.0:1787836382.447421:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.447534:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193143808 00000100:00100000:1.0:1787836382.447542:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193143808 00000100:00100000:1.0:1787836382.447595:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836382.447605:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193143808:12345-0@lo:13: 00002000:00000024:1.0:1787836382.447639:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836382.447684:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193143808:12345-0@lo:13: Request processed in 80us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.447691:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787836382.447765:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d1b840 x1874682193143808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836382.447783:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193143808:0@lo:13: 00000020:00000080:2.0:1787836382.454350:0:8449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff20ac1a0 20000000:00000080:2.0:1787836382.454367:0:8449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e3f5f91400 uarg=0000000000000000 20000000:01000000:2.0:1787836382.454400:0:8449:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787836382.454403:0:8449:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787836382.454405:0:8449:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787836382.454409:0:8449:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787836382.454414:0:8449:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787836382.454427:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787836382.454429:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787836382.454697:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787836382.454701:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787836382.455676:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787836382.456309:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787836382.456369:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787836382.456426:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787836382.456440:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787836382.456442:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787836382.459398:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787836382.460045:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787836382.460467:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787836382.460508:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787836382.460522:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787836382.460525:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787836382.461331:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787836382.461758:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787836382.461816:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787836382.461855:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787836382.461869:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787836382.461871:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787836382.462804:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787836382.465605:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787836382.465686:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787836382.465723:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1787836382.465741:0:8449:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787836382.465759:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465777:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7375 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465784:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab739f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465791:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465797:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465803:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465809:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7401 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465815:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab742b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465843:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465850:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465857:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465894:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.465910:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 9 pid: 5833 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.465925:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193143936:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836382.466022:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.466031:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 9 pid: 5836 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.466040:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144064:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836382.466105:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab742b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.466113:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab742b expref: 18 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.467632:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144192:0@lo:104: 00000100:00100000:3.0:1787836382.467691:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836382.467869:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7401 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.467883:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7401 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.467896:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144320:0@lo:104: 00000100:00100000:3.0:1787836382.467923:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836382.467956:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.467965:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.467973:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144448:0@lo:104: 00010000:00010000:3.0:1787836382.467998:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.468006:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.468013:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144576:0@lo:104: 00010000:00010000:3.0:1787836382.468035:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.468043:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.468085:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144704:0@lo:104: 00010000:00010000:3.0:1787836382.468114:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab739f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.468122:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab739f expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.468130:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144832:0@lo:104: 00000100:00100000:1.0:1787836382.468491:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787836382.468514:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.468529:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.468537:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.468545:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193144192 00000100:00100000:1.0:1787836382.468551:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193144192 00000100:00100000:1.0:1787836382.468591:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193144320 00000100:00100000:1.0:1787836382.468594:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193144320 00000100:00100000:1.0:1787836382.468616:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193144448 00000100:00100000:1.0:1787836382.468619:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193144448 00000100:00100000:1.0:1787836382.468628:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193144576 00000100:00100000:1.0:1787836382.468630:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193144576 00000100:00100000:1.0:1787836382.468639:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193144704 00000100:00100000:1.0:1787836382.468641:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193144704 00000100:00100000:1.0:1787836382.468654:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787836382.468662:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+7:8449:x1874682193144192:12345-0@lo:104: 00010000:00010000:1.0:1787836382.468675:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.468746:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787836382.468753:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+7:8449:x1874682193144192:12345-0@lo:104: Request processed in 92us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.468759:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787836382.468781:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836382.468787:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+6:8449:x1874682193144320:12345-0@lo:104: 00010000:00010000:1.0:1787836382.468796:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.468827:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787836382.468832:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+6:8449:x1874682193144320:12345-0@lo:104: Request processed in 46us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.468838:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836382.468875:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787836382.468882:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:8449:x1874682193144448:12345-0@lo:104: 00010000:00010000:1.0:1787836382.468891:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.468932:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787836382.468937:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:8449:x1874682193144448:12345-0@lo:104: Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.468944:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787836382.468956:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787836382.468963:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:8449:x1874682193144576:12345-0@lo:104: 00010000:00010000:1.0:1787836382.468970:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.468997:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787836382.469001:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:8449:x1874682193144576:12345-0@lo:104: Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.469007:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787836382.469019:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787836382.469024:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:8449:x1874682193144704:12345-0@lo:104: 00010000:00010000:1.0:1787836382.469031:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469077:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787836382.469082:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:8449:x1874682193144704:12345-0@lo:104: Request processed in 59us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.469088:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787836382.469109:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787836382.469115:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469123:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c13a0200 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836382.469146:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469165:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836382.469174:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836382.469180:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836382.469212:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469218:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836382.469239:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469246:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c13a0200/0x966835ea68ab742b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7432 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469261:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787836382.469265:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469271:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031a00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836382.469274:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469281:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836382.469299:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836382.469304:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836382.469319:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469325:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836382.469341:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469348:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0031a00/0x966835ea68ab7401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7408 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469358:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787836382.469361:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469367:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030800 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836382.469369:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469376:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836382.469382:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836382.469388:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836382.469408:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469414:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836382.469420:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469426:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0030800/0x966835ea68ab73e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73ec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469436:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836382.469439:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469445:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836382.469448:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469455:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836382.469461:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836382.469465:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836382.469477:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469483:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836382.469488:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469503:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab73d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469513:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836382.469516:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469522:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836382.469524:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469531:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836382.469537:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836382.469541:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836382.469555:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469560:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836382.469564:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469569:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c152b600/0x966835ea68ab73c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.469577:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836382.469584:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836382.469586:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836382.469593:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836382.469611:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193144960:0@lo:103: 00000100:00100000:1.0:1787836382.469646:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.469667:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193145472:0@lo:103: 00000100:00100000:1.0:1787836382.469684:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.469712:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836382.469718:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193145344:0@lo:103: 00000100:00100000:1.0:1787836382.469738:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.469761:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193145088:0@lo:103: 00000100:00100000:1.0:1787836382.469781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.469795:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836382.469800:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193145216:0@lo:103: 00000100:00100000:1.0:1787836382.469818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836382.469847:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193144960 00000100:00100000:1.0:1787836382.469852:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193144960 00010000:00010000:1.0:1787836382.469874:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab742b expref: 19 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836382.469890:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193145472 00000100:00100000:1.0:1787836382.469892:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193145472 00010000:00010000:1.0:1787836382.469903:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 20 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836382.469913:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193145344 00000100:00100000:1.0:1787836382.469916:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193145344 00010000:00010000:1.0:1787836382.469926:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 21 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836382.469951:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193145088 00000100:00100000:1.0:1787836382.469955:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193145088 00010000:00010000:1.0:1787836382.469968:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7401 expref: 22 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836382.469978:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193145216 00000100:00100000:1.0:1787836382.469980:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193145216 00010000:00010000:1.0:1787836382.469990:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 23 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836382.470002:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787836382.470009:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+23:3313:x1874682193144960:12345-0@lo:103: 00010000:00010000:1.0:1787836382.470019:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836382.470024:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab742b expref: 23 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470033:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab742b expref: 23 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470049:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836382.470100:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+23:3313:x1874682193144960:12345-0@lo:103: Request processed in 92us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.470107:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787836382.470122:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836382.470129:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+22:3313:x1874682193145472:12345-0@lo:103: 00010000:00010000:1.0:1787836382.470137:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836382.470142:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 22 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470170:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 22 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470180:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836382.470202:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+22:3313:x1874682193145472:12345-0@lo:103: Request processed in 75us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.470209:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836382.470222:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787836382.470228:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+21:3313:x1874682193145344:12345-0@lo:103: 00010000:00010000:1.0:1787836382.470235:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836382.470239:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 21 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470247:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 21 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470257:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836382.470279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+21:3313:x1874682193145344:12345-0@lo:103: Request processed in 51us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.470284:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787836382.470297:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787836382.470304:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d19e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+20:3310:x1874682193145088:12345-0@lo:103: 00010000:00010000:1.0:1787836382.470311:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836382.470316:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7401 expref: 20 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470323:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7401 expref: 20 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470338:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836382.470368:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d19e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+20:3310:x1874682193145088:12345-0@lo:103: Request processed in 65us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.470374:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787836382.470386:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787836382.470392:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193145216:12345-0@lo:103: 00010000:00010000:1.0:1787836382.470400:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836382.470404:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 19 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470412:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 19 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836382.470421:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836382.470442:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193145216:12345-0@lo:103: Request processed in 50us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836382.470448:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787836382.470484:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193145344:0@lo:103: 00000100:00100000:1.0:1787836382.470493:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193144960:0@lo:103: 00000100:00100000:1.0:1787836382.470500:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193145472:0@lo:103: 00000100:00100000:1.0:1787836382.470524:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193145216:0@lo:103: 00000100:00100000:1.0:1787836382.470531:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193145088:0@lo:103: 00000100:00100000:3.0:1787836382.470828:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836382.470869:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7375 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.470879:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7375 expref: 18 pid: 5836 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.470890:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193145600:0@lo:104: 00000100:00100000:3.0:1787836382.470911:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836382.470923:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99480 going to sleep for 11 seconds 00010000:00010000:3.0:1787836382.470936:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c13a0a00/0x966835ea68ab7432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab742b expref: 18 pid: 5835 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.470947:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144192:0@lo:104: 00010000:00010000:3.0:1787836382.470957:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab7408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7401 expref: 17 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.470965:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144320:0@lo:104: 00010000:00010000:3.0:1787836382.470973:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c13a1000/0x966835ea68ab73ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab73e5 expref: 16 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.470991:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144448:0@lo:104: 00010000:00010000:3.0:1787836382.471003:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c152be00/0x966835ea68ab73de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab73d7 expref: 15 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.471011:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144576:0@lo:104: 00010000:00010000:3.0:1787836382.471019:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0030c00/0x966835ea68ab73d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab73c9 expref: 14 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.471026:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144704:0@lo:104: 00000100:00100000:2.0:1787836382.471121:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193144832 00000100:00100000:2.0:1787836382.471133:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193144832 00000100:00100000:2.0:1787836382.471177:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193145600 00000100:00100000:2.0:1787836382.471181:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193145600 00000100:00100000:2.0:1787836382.471195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836382.471202:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:8449:x1874682193144832:12345-0@lo:104: 00010000:00010000:2.0:1787836382.471213:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471263:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787836382.471269:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:8449:x1874682193144832:12345-0@lo:104: Request processed in 68us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836382.471275:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836382.471288:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787836382.471294:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:8449:x1874682193145600:12345-0@lo:104: 00010000:00010000:2.0:1787836382.471302:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471335:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787836382.471340:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:8449:x1874682193145600:12345-0@lo:104: Request processed in 47us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836382.471346:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787836382.471361:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787836382.471366:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471373:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b200 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:2.0:1787836382.471376:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471395:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787836382.471403:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836382.471409:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787836382.471434:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471440:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787836382.471454:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471461:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c152b200/0x966835ea68ab739f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab73a6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471473:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836382.471476:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471481:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a400 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:2.0:1787836382.471484:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471491:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787836382.471497:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836382.471509:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787836382.471524:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471530:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787836382.471535:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471540:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c152a400/0x966835ea68ab7375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab737c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471553:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836382.471555:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836382.471556:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836382.471570:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836382.471575:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836382.471592:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193145856:0@lo:103: 00000100:00100000:2.0:1787836382.471620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836382.471650:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836382.471655:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193145728:0@lo:103: 00000100:00100000:2.0:1787836382.471676:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836382.471830:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193145856 00000100:00100000:2.0:1787836382.471835:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193145856 00010000:00010000:2.0:1787836382.471852:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7375 expref: 14 pid: 5836 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836382.471873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193145728 00000100:00100000:2.0:1787836382.471876:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193145728 00010000:00010000:2.0:1787836382.471888:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab739f expref: 15 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836382.471915:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836382.471922:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:3311:x1874682193145856:12345-0@lo:103: 00010000:00010000:2.0:1787836382.471933:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836382.471938:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7375 expref: 15 pid: 5836 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471947:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7375 expref: 15 pid: 5836 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.471961:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836382.471991:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:3311:x1874682193145856:12345-0@lo:103: Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836382.471997:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836382.472010:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787836382.472016:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8603850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:3311:x1874682193145728:12345-0@lo:103: 00010000:00010000:2.0:1787836382.472023:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836382.472026:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab739f expref: 14 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.472034:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab739f expref: 14 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.472044:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836382.472094:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8603850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:3311:x1874682193145728:12345-0@lo:103: Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836382.472100:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787836382.472236:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193145728:0@lo:103: 00000100:00100000:2.0:1787836382.472254:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193145856:0@lo:103: 00010000:00010000:3.0:1787836382.475281:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031800/0x966835ea68ab73a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab739f expref: 13 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.475301:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144832:0@lo:104: 00010000:00010000:3.0:1787836382.475312:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005a200/0x966835ea68ab737c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7375 expref: 12 pid: 5836 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.475319:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193145600:0@lo:104: 00000100:00100000:2.0:1787836382.475520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836382.475564:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172149760 00000100:00100000:2.0:1787836382.475571:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172149760 00010000:00010000:2.0:1787836382.475607:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 10 pid: 5833 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836382.475637:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836382.475646:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172149760:12345-192.168.203.25@tcp:103: 00010000:00010000:2.0:1787836382.475658:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836382.475663:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 10 pid: 5833 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.475675:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 10 pid: 5833 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.475694:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836382.475854:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172149760:12345-192.168.203.25@tcp:103: Request processed in 208us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836382.475863:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00010000:00010000:3.0:1787836382.477526:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ace00/0x966835ea68ab7447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd5a expref: 9 pid: 5833 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.477546:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193143936:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836382.477559:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874682193144064:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836382.477601:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836382.477778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836382.477953:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172149888 00000100:00100000:3.0:1787836382.477973:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172149888 00010000:00010000:3.0:1787836382.478012:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 9 pid: 5836 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836382.478049:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1787836382.478084:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:2363:x1874682172149888:12345-192.168.203.25@tcp:103: 00010000:00010000:3.0:1787836382.478097:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836382.478102:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 9 pid: 5836 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478113:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 9 pid: 5836 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478129:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c13a1e00/0x966835ea68ab7440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd53 expref: 9 pid: 5836 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478460:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478471:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478487:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478494:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478501:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478584:0:7631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478591:0:7631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836382.478594:0:7631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.478602:0:7631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.479010:0:8449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836382.479019:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.497549:0:7631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.497568:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab747f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836382.497591:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836382.497674:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:2363:x1874682172149888:12345-192.168.203.25@tcp:103: Request processed in 19611us (19891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836382.497683:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00010000:00010000:2.0:1787836383.406272:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836383.983200:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193145984:0@lo:13: 00000100:00100000:1.0:1787836383.983267:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836383.983355:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193145984 00000100:00100000:1.0:1787836383.983362:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193145984 00000100:00100000:1.0:1787836383.983413:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787836383.983423:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193145984:12345-0@lo:13: 00002000:00000024:1.0:1787836383.983454:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836383.983494:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193145984:12345-0@lo:13: Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836383.983501:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787836383.983552:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fae83840 x1874682193145984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836383.983572:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193145984:0@lo:13: 00000100:00080000:0.0:1787836383.984388:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1787836384.174421:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787836384.174429:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e2c1c4b800 from 39 10000000:01000000:2.0:1787836384.174435:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787836384.174482:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.174495:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.174506:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836384.174530:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146112:0@lo:101: 00000100:00100000:2.0:1787836384.174597:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836384.174718:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50600 going to sleep for 11 seconds 00000100:00100000:3.0:1787836384.176167:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193146112 00000100:00100000:3.0:1787836384.176183:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193146112 00000100:00100000:3.0:1787836384.176275:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787836384.176289:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+12:5839:x1874682193146112:12345-0@lo:101: 00010000:00010000:3.0:1787836384.176330:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836384.176355:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab748d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7486 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836384.176384:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab748d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7486 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836384.176408:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab748d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7486 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836384.176432:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac200, rc 0) 00000100:00100000:3.0:1787836384.176535:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193146112:12345-0@lo:101: Request processed in 250us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.176541:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787836384.177025:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146112:0@lo:101: 00010000:00010000:1.0:1787836384.177046:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.177081:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836384.177157:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146240:0@lo:501: 00000100:00100000:1.0:1787836384.177202:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.177240:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e970bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.177525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193146240 00000100:00100000:2.0:1787836384.177531:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193146240 00000100:00100000:2.0:1787836384.177626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787836384.177636:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193146240:12345-0@lo:501: 00000100:00100000:2.0:1787836384.177920:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193146240:12345-0@lo:501: Request processed in 285us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.177928:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787836384.178184:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146240:0@lo:501: 00000100:00100000:1.0:1787836384.178222:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146368:0@lo:503: 00000100:00100000:1.0:1787836384.178277:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836384.179440:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193146368 00000100:00100000:1.0:1787836384.179476:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e970bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787836384.179496:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193146368 00000100:00100000:0.0:1787836384.179586:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787836384.179595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193146368:12345-0@lo:503: 00000100:00100000:0.0:1787836384.179922:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193146368:12345-0@lo:503: Request processed in 327us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836384.179929:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787836384.180219:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146368:0@lo:503: 00000100:00100000:3.0:1787836384.180790:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8468:1874682193146496:0@lo:502: 00000100:00100000:3.0:1787836384.180843:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836384.180919:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99780 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.180961:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193146496 00000100:00100000:2.0:1787836384.180966:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193146496 00000100:00100000:2.0:1787836384.181097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787836384.181104:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:8468:x1874682193146496:12345-0@lo:502: 00000100:00100000:2.0:1787836384.181448:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:8468:x1874682193146496:12345-0@lo:502: Request processed in 343us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.181455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787836384.181553:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8468:1874682193146496:0@lo:502: 00000100:00100000:3.0:1787836384.181600:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8468:1874682193146624:0@lo:502: 00000100:00100000:3.0:1787836384.181636:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836384.181710:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99780 going to sleep for 11 seconds 00000100:00100000:0.0:1787836384.181783:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193146624 00000100:00100000:0.0:1787836384.181787:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193146624 00000100:00100000:0.0:1787836384.181815:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787836384.181822:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:8468:x1874682193146624:12345-0@lo:502: 00000100:00100000:0.0:1787836384.182217:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:8468:x1874682193146624:12345-0@lo:502: Request processed in 394us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836384.182225:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787836384.182393:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8468:1874682193146624:0@lo:502: 00000040:00080000:3.0:1787836384.182421:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787836384.183227:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787836384.183254:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787836384.183266:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.183279:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836384.183288:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787836384.183291:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787836384.183294:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787836384.183326:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.183333:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.183344:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836384.183362:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146752:0@lo:101: 00000100:00100000:1.0:1787836384.183412:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.183451:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981540 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.184751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193146752 00000100:00100000:2.0:1787836384.184763:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193146752 00000100:00100000:2.0:1787836384.184818:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787836384.184827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+13:5839:x1874682193146752:12345-0@lo:101: 00010000:00010000:2.0:1787836384.184839:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836384.184855:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a600/0x966835ea68ab749b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7494 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.184882:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a600/0x966835ea68ab749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7494 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.184892:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a600/0x966835ea68ab749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7494 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.184901:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a600, rc 0) 00000100:00100000:2.0:1787836384.184981:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193146752:12345-0@lo:101: Request processed in 154us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.184987:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787836384.185591:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146752:0@lo:101: 00010000:00010000:1.0:1787836384.185613:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.185623:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836384.185705:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146880:0@lo:501: 00000100:00100000:1.0:1787836384.185747:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.185779:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981540 going to sleep for 11 seconds 00000100:00100000:0.0:1787836384.186267:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193146880 00000100:00100000:0.0:1787836384.186280:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193146880 00000100:00100000:0.0:1787836384.186326:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787836384.186335:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193146880:12345-0@lo:501: 00000100:00100000:0.0:1787836384.186612:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193146880:12345-0@lo:501: Request processed in 278us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836384.186619:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787836384.186708:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193146880:0@lo:501: 00000100:00100000:1.0:1787836384.186747:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193147008:0@lo:503: 00000100:00100000:1.0:1787836384.186792:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.186826:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981540 going to sleep for 11 seconds 00000100:00100000:3.0:1787836384.186877:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193147008 00000100:00100000:3.0:1787836384.186882:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193147008 00000100:00100000:3.0:1787836384.187133:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787836384.187142:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193147008:12345-0@lo:503: 00000100:00100000:3.0:1787836384.187309:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193147008:12345-0@lo:503: Request processed in 168us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.187316:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787836384.187457:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193147008:0@lo:503: 00000100:00100000:1.0:1787836384.188391:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8469:1874682193147136:0@lo:502: 00000100:00100000:1.0:1787836384.188456:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.188496:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981300 going to sleep for 11 seconds 00000100:00100000:3.0:1787836384.188546:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193147136 00000100:00100000:3.0:1787836384.188551:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193147136 00000100:00100000:3.0:1787836384.188601:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787836384.188611:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:8469:x1874682193147136:12345-0@lo:502: 00000100:00100000:3.0:1787836384.188809:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:8469:x1874682193147136:12345-0@lo:502: Request processed in 200us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.188817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787836384.189177:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8469:1874682193147136:0@lo:502: 00000020:01000000:2.0:1787836384.189208:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787836384.189218:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836384.189220:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787836384.189227:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787836384.189252:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae80b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8469:1874682193147264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836384.189292:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836384.189319:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50180 going to sleep for 11 seconds 00000100:00100000:3.0:1787836384.190192:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193147264 00000100:00100000:3.0:1787836384.190201:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193147264 00000100:00100000:3.0:1787836384.190327:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787836384.190339:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:8469:x1874682193147264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836384.190579:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:8469:x1874682193147264:12345-0@lo:502:llog_process_th.0 Request processed in 243us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.190587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787836384.190679:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae80b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8469:1874682193147264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787836384.190708:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787836384.190714:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836384.190717:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787836384.190722:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787836384.190783:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787836384.190799:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787836384.190817:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.190828:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836384.190838:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787836384.190841:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3d01b2000 from 39 10000000:01000000:0.0:1787836384.190844:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787836384.190874:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.190882:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.190892:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836384.190912:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193147392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787836384.190945:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836384.193582:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.193775:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193147392 00000100:00100000:2.0:1787836384.193783:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193147392 00000100:00100000:2.0:1787836384.193832:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787836384.193856:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+14:5839:x1874682193147392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836384.193872:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836384.193890:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005b400/0x966835ea68ab74a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab74a2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.193918:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005b400/0x966835ea68ab74a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab74a2 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.193930:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005b400/0x966835ea68ab74a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab74a2 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.193937:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b400, rc 0) 00000100:00100000:2.0:1787836384.194020:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193147392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.194027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787836384.194354:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193147392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836384.194372:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.194382:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836384.194449:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193147520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836384.194501:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836384.194518:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.194708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193147520 00000100:00100000:2.0:1787836384.194713:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193147520 00000100:00100000:2.0:1787836384.194737:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787836384.194744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193147520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.195014:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193147520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.195021:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787836384.195323:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193147520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836384.195360:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193147648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836384.195404:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836384.195443:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ece0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836384.195533:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193147648 00000100:00100000:1.0:1787836384.195538:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193147648 00000100:00100000:1.0:1787836384.195569:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787836384.195576:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193147648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787836384.195723:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193147648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836384.195730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787836384.195858:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193147648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836384.196352:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8470:1874682193147776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836384.196395:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836384.196431:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8eced80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836384.196563:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193147776 00000100:00100000:1.0:1787836384.196568:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193147776 00000100:00100000:1.0:1787836384.196604:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787836384.196612:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:8470:x1874682193147776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836384.196808:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:8470:x1874682193147776:12345-0@lo:502:llog_process_th.0 Request processed in 196us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836384.196826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787836384.197648:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8470:1874682193147776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836384.197714:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8470:1874682193147904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836384.197762:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836384.197790:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8eced80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836384.197846:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193147904 00000100:00100000:1.0:1787836384.197852:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193147904 00000100:00100000:1.0:1787836384.197891:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787836384.197899:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:8470:x1874682193147904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836384.198120:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:8470:x1874682193147904:12345-0@lo:502:llog_process_th.0 Request processed in 221us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836384.198127:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787836384.199689:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8470:1874682193147904:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787836384.199739:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787836384.199923:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787836384.199943:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787836384.199956:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.199965:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836384.199974:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787836384.199977:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787836384.199979:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787836384.200029:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.200037:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.200045:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836384.200090:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787836384.200164:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.200193:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.200543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193148032 00000100:00100000:2.0:1787836384.200548:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193148032 00000100:00100000:2.0:1787836384.200587:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787836384.200595:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:5839:x1874682193148032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836384.200615:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836384.200628:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a400/0x966835ea68ab74b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab74b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.200655:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a400/0x966835ea68ab74b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab74b0 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.200667:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a400/0x966835ea68ab74b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab74b0 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.200676:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a400, rc 0) 00000100:00100000:2.0:1787836384.200723:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193148032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.200731:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787836384.200855:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787836384.200871:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.200880:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836384.200930:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787836384.200957:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.200989:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.201555:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193148160 00000100:00100000:2.0:1787836384.201561:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193148160 00000100:00100000:2.0:1787836384.201598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787836384.201606:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193148160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.201875:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193148160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.201882:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787836384.201995:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787836384.202030:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787836384.202210:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.202231:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.202316:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193148288 00000100:00100000:2.0:1787836384.202321:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193148288 00000100:00100000:2.0:1787836384.202386:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787836384.202394:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193148288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.202562:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193148288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.202578:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787836384.202645:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787836384.202885:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8471:1874682193148416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836384.202917:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.203273:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c34293c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836384.203320:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193148416 00000100:00100000:0.0:1787836384.203325:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193148416 00000100:00100000:0.0:1787836384.203354:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787836384.203361:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:8471:x1874682193148416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836384.205463:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:8471:x1874682193148416:12345-0@lo:502:llog_process_th.0 Request processed in 2092us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836384.205475:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787836384.207644:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8471:1874682193148416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787836384.207689:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836384.207700:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836384.207703:0:8471:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787836384.207709:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787836384.207761:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8471:1874682193148544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836384.207828:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.207882:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c34293c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836384.208199:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193148544 00000100:00100000:3.0:1787836384.208206:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193148544 00000100:00100000:3.0:1787836384.208249:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787836384.208258:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:8471:x1874682193148544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836384.208504:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:8471:x1874682193148544:12345-0@lo:502:llog_process_th.0 Request processed in 247us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.208512:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787836384.208704:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8471:1874682193148544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787836384.208729:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836384.208735:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836384.208737:0:8471:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787836384.208742:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787836384.208897:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787836384.208914:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787836384.208922:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.208932:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836384.208941:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787836384.208944:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3ce1d0800 from 39 10000000:01000000:2.0:1787836384.208947:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787836384.208972:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.209035:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.209044:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836384.209255:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.209298:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836384.209334:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50540 going to sleep for 11 seconds 00000100:00100000:0.0:1787836384.210325:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193148672 00000100:00100000:0.0:1787836384.210335:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193148672 00000100:00100000:0.0:1787836384.210385:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787836384.210408:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193148672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836384.210425:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836384.210443:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0030e00/0x966835ea68ab74c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab74be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.210471:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0030e00/0x966835ea68ab74c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab74be expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.210481:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0030e00/0x966835ea68ab74c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab74be expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.210490:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030e00, rc 0) 00000100:00100000:0.0:1787836384.210562:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193148672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836384.210569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787836384.210898:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836384.210918:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.210938:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836384.211010:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.211048:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836384.211619:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50540 going to sleep for 11 seconds 00000100:00100000:3.0:1787836384.211785:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193148800 00000100:00100000:3.0:1787836384.211792:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193148800 00000100:00100000:3.0:1787836384.211835:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787836384.211844:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193148800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836384.213839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193148800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1987us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.213857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787836384.213965:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.214014:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.214199:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.214223:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193148928 00000100:00100000:2.0:1787836384.214229:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50540 going to sleep for 11 seconds 00000100:00100000:1.0:1787836384.214229:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193148928 00000100:00100000:1.0:1787836384.214287:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787836384.214296:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193148928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787836384.214491:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193148928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836384.214498:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787836384.214711:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193148928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836384.215788:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8472:1874682193149056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836384.215853:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836384.215893:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.215897:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193149056 00000100:00100000:2.0:1787836384.215903:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193149056 00000100:00100000:2.0:1787836384.215943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787836384.215952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:8472:x1874682193149056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836384.216215:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:8472:x1874682193149056:12345-0@lo:502:llog_process_th.0 Request processed in 263us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836384.216223:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787836384.216479:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8472:1874682193149056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836384.216522:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8472:1874682193149184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836384.216552:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836384.216574:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787836384.216712:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193149184 00000100:00100000:1.0:1787836384.216717:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193149184 00000100:00100000:1.0:1787836384.216752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787836384.216759:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:8472:x1874682193149184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836384.216910:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:8472:x1874682193149184:12345-0@lo:502:llog_process_th.0 Request processed in 151us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836384.216917:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787836384.217379:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8472:1874682193149184:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787836384.217406:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787836384.222363:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787836384.222399:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787836384.222410:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.222423:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836384.222450:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787836384.222590:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787836384.222595:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787836384.222632:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.222641:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.222652:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836384.222678:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193149312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.222748:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836384.222825:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50240 going to sleep for 11 seconds 00000100:00100000:1.0:1787836384.222879:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193149312 00000100:00100000:1.0:1787836384.222886:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193149312 00000100:00100000:1.0:1787836384.223011:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787836384.223021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193149312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787836384.223034:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836384.223055:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f4400/0x966835ea68ab74d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab74cc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.223243:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f4400/0x966835ea68ab74d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab74cc expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.223358:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f4400/0x966835ea68ab74d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab74cc expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.223367:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4400, rc 0) 00000100:00100000:1.0:1787836384.223421:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193149312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 402us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836384.223428:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787836384.223445:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193149312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836384.223465:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.223476:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836384.223534:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193149440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836384.223563:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836384.223592:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50240 going to sleep for 11 seconds 00000100:00100000:3.0:1787836384.223633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193149440 00000100:00100000:3.0:1787836384.223638:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193149440 00000100:00100000:3.0:1787836384.223675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787836384.223683:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193149440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836384.223997:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193149440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.224004:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787836384.224465:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193149440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836384.224592:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193149568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836384.224641:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836384.224676:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836384.224742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193149568 00000100:00100000:0.0:1787836384.224747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193149568 00000100:00100000:0.0:1787836384.224794:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787836384.224802:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193149568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836384.225009:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193149568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836384.225015:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787836384.225208:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193149568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836384.225629:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8473:1874682193149696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836384.225670:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836384.225744:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836384.226030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193149696 00000100:00100000:2.0:1787836384.226046:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193149696 00000100:00100000:3.0:1787836384.226370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787836384.226386:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:8473:x1874682193149696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836384.226642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:8473:x1874682193149696:12345-0@lo:502:llog_process_th.0 Request processed in 258us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.226650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787836384.227177:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8473:1874682193149696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787836384.227212:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836384.227221:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836384.227223:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787836384.227230:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787836384.227273:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8473:1874682193149824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836384.227319:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836384.227354:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836384.227468:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193149824 00000100:00100000:0.0:1787836384.227473:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193149824 00000100:00100000:0.0:1787836384.227503:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787836384.227511:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:8473:x1874682193149824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836384.227698:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:8473:x1874682193149824:12345-0@lo:502:llog_process_th.0 Request processed in 187us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836384.227711:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787836384.227798:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8473:1874682193149824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787836384.227817:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836384.227822:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836384.227823:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787836384.227828:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787836384.228078:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787836384.228101:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787836384.228120:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.228140:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836384.228157:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787836384.228160:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e3c7faced8 from 1 10000000:01000000:0.0:1787836384.228163:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787836384.228188:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.228195:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836384.228203:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836384.228216:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193149952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787836384.228243:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836384.228266:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8eced80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836384.228365:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193149952 00000100:00100000:1.0:1787836384.228370:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193149952 00000100:00100000:1.0:1787836384.228402:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787836384.228409:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193149952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787836384.228418:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836384.228430:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab74e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab74da expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.228462:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab74e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab74da expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.228472:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab74e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab74da expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836384.228480:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4c00, rc 0) 00000100:00100000:1.0:1787836384.228523:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193149952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836384.228529:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787836384.228668:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193149952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836384.228682:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836384.228690:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836384.228746:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193150080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836384.228771:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836384.228800:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836384.228828:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193150080 00000100:00100000:1.0:1787836384.228832:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193150080 00000100:00100000:1.0:1787836384.228849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787836384.228855:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193150080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787836384.229084:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193150080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (311us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787836384.229092:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787836384.229433:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193150080:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787836384.229457:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787836384.229464:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836384.229472:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836384.430235:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836384.874262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836384.874345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836384.874424:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172150272 00000100:00100000:3.0:1787836384.874433:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172150272 00000100:00100000:3.0:1787836384.874639:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:3.0:1787836384.874658:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172150272:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1787836384.874749:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172150272:12345-192.168.203.25@tcp:400: Request processed in 100us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.874757:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:3.0:1787836384.874815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836384.875025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836384.875055:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172150144 00000100:00100000:3.0:1787836384.875081:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172150144 00000100:00100000:3.0:1787836384.875117:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:3.0:1787836384.875125:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172150144:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1787836384.875168:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172150144:12345-192.168.203.25@tcp:400: Request processed in 45us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.875175:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:3.0:1787836384.875199:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172150400 00000100:00100000:3.0:1787836384.875204:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172150400 00000100:00100000:3.0:1787836384.875228:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1787836384.875235:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172150400:12345-192.168.203.25@tcp:400: 00000100:00100000:3.0:1787836384.875259:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172150400:12345-192.168.203.25@tcp:400: Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836384.875265:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00080000:1.0:1787836384.875346:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836384.875350:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787836384.875352:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836384.875888:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172150016 00000100:00100000:0.0:1787836384.875894:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172150016 00000100:00100000:0.0:1787836384.875968:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 164 00000100:00100000:0.0:1787836384.875976:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:2362:x1874682172150016:12345-192.168.203.25@tcp:400: 00000100:00100000:0.0:1787836384.876033:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:2362:x1874682172150016:12345-192.168.203.25@tcp:400: Request processed in 58us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836384.876040:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 164 00010000:00010000:2.0:1787836385.457512:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836385.839109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836385.839451:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172150528 00000100:00100000:1.0:1787836385.839464:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172150528 00000100:00100000:1.0:1787836385.839562:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 165 00000100:00100000:1.0:1787836385.839573:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:5601:x1874682172150528:12345-192.168.203.25@tcp:101: 00010000:00010000:1.0:1787836385.839589:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836385.839608:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab74e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000eddbc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836385.839662:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab74e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddbc expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836385.839676:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab74e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddbc expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836385.839687:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5200, rc 0) 00000100:00100000:1.0:1787836385.839780:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5601:x1874682172150528:12345-192.168.203.25@tcp:101: Request processed in 208us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836385.839787:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 165 00000100:00100000:3.0:1787836385.842481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836385.842596:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172150656 00000100:00100000:0.0:1787836385.842608:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172150656 00000100:00100000:0.0:1787836385.842671:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00100000:0.0:1787836385.842680:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5601:x1874682172150656:12345-192.168.203.25@tcp:501: 00000100:00100000:0.0:1787836385.843165:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5601:x1874682172150656:12345-192.168.203.25@tcp:501: Request processed in 484us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836385.843174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00100000:3.0:1787836385.846187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836385.846342:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172150784 00000100:00100000:1.0:1787836385.846353:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172150784 00000100:00100000:1.0:1787836385.846535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:1.0:1787836385.846545:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5601:x1874682172150784:12345-192.168.203.25@tcp:503: 00000100:00100000:1.0:1787836385.846878:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5601:x1874682172150784:12345-192.168.203.25@tcp:503: Request processed in 213us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836385.846888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:3.0:1787836385.851788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836385.851875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172150912 00000100:00100000:0.0:1787836385.851886:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172150912 00000100:00100000:0.0:1787836385.851952:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 168 00000100:00100000:0.0:1787836385.851972:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:6086:x1874682172150912:12345-192.168.203.25@tcp:502: 00000100:00100000:0.0:1787836385.852749:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:6086:x1874682172150912:12345-192.168.203.25@tcp:502: Request processed in 784us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836385.852758:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 168 00000100:00100000:3.0:1787836385.856791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836385.856929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172151040 00000100:00100000:1.0:1787836385.856943:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172151040 00000100:00100000:1.0:1787836385.857365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:1.0:1787836385.857378:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:6086:x1874682172151040:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787836385.857759:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:6086:x1874682172151040:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 382us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836385.857767:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:2.0:1787836385.860784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836385.860882:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172151168 00000100:00100000:0.0:1787836385.860897:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172151168 00000100:00100000:0.0:1787836385.860953:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:0.0:1787836385.860972:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5601:x1874682172151168:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836385.860989:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836385.861016:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0031e00/0x966835ea68ab74ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000eddc3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836385.861262:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0031e00/0x966835ea68ab74ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddc3 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836385.861290:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0031e00/0x966835ea68ab74ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddc3 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836385.861299:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031e00, rc 0) 00000100:00100000:0.0:1787836385.861367:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5601:x1874682172151168:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 405us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836385.861374:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:3.0:1787836385.866734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836385.866873:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172151296 00000100:00100000:1.0:1787836385.866910:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172151296 00000100:00100000:1.0:1787836385.867620:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 171 00000100:00100000:1.0:1787836385.867640:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5601:x1874682172151296:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787836385.868262:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5601:x1874682172151296:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 626us (1540us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787836385.868273:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 171 00010000:00010000:2.0:1787836386.478187:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836387.054459:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193150592:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.054531:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836387.054609:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787836387.054615:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193150208:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.054644:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836387.054668:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193150720:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.054692:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836387.054720:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193150464:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.054742:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836387.054760:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787836387.054766:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193150336:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.054786:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836387.054803:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193150848:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.054822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836387.054864:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193150208 00000100:00100000:2.0:1787836387.054870:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193150208 00000100:00100000:2.0:1787836387.054909:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787836387.054917:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193150208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.054965:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193150208:12345-0@lo:400:kworker.0 Request processed in 48us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836387.054971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787836387.055001:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193150720 00000100:00100000:2.0:1787836387.055005:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193150720 00000100:00100000:2.0:1787836387.055030:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193150464 00000100:00100000:2.0:1787836387.055033:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193150464 00000100:00100000:2.0:1787836387.055044:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193150336 00000100:00100000:2.0:1787836387.055046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193150336 00000100:00100000:2.0:1787836387.055088:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787836387.055096:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193150720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.055141:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193150720:12345-0@lo:400:kworker.0 Request processed in 46us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836387.055147:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787836387.055160:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787836387.055166:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193150464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.055200:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193150464:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836387.055205:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787836387.055217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787836387.055222:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193150336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.055246:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193150336:12345-0@lo:400:kworker.0 Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836387.055263:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787836387.055288:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193150592 00000100:00100000:2.0:1787836387.055292:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193150592 00000100:00100000:2.0:1787836387.055316:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193150848 00000100:00100000:2.0:1787836387.055319:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193150848 00000100:00100000:2.0:1787836387.055334:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787836387.055340:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193150592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.055371:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193150592:12345-0@lo:400:kworker.0 Request processed in 32us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836387.055377:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787836387.055387:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836387.055393:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193150848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.055415:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193150848:12345-0@lo:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836387.055420:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836387.055453:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193150336:0@lo:400:kworker.0 00010000:00080000:2.0:1787836387.055465:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fbad00 x1874682193150848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836387.055475:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193150848:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.055485:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193150464:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.055513:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193150208:0@lo:400:kworker.0 00000100:00100000:2.0:1787836387.055523:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193150720:0@lo:400:kworker.0 00010000:00080000:2.0:1787836387.055532:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fba940 x1874682193150592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836387.055547:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193150592:0@lo:400:kworker.0 00000100:00080000:1.0:1787836387.055845:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836387.055850:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836387.055853:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787836387.504869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836387.566440:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836387.566463:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193150976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836387.566523:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836387.566671:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193150976 00000100:00100000:1.0:1787836387.566679:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193150976 00000100:00100000:1.0:1787836387.566741:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787836387.566750:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193150976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787836387.566782:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836387.566840:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193150976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836387.566847:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787836387.566889:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d183c0 x1874682193150976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836387.566906:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193150976:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1787836387.961829:0:8511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc8388300 20000000:00000080:1.0:1787836387.961847:0:8511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e2c1d70400 uarg=0000000000000000 20000000:01000000:1.0:1787836387.961882:0:8511:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787836387.961888:0:8511:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787836387.961892:0:8511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787836387.971267:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787836387.971506:0:8511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787836387.987396:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787836387.987453:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787836387.987521:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787836387.987539:0:8511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787836387.987558:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987576:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c13a0800/0x966835ea68ab72bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987584:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7336 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987591:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7391 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987600:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987607:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987644:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987659:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 9 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836387.987674:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874682193151104:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836387.987774:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7391 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987783:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7391 expref: 18 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836387.987814:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874682193151232:0@lo:104: 00000100:00100000:3.0:1787836387.987855:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836387.987894:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7336 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987902:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7336 expref: 18 pid: 5833 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836387.987909:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874682193151360:0@lo:104: 00000100:00100000:3.0:1787836387.987933:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836387.987958:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c13a0800/0x966835ea68ab72bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.987965:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3c13a0800/0x966835ea68ab72bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 18 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836387.987973:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874682193151488:0@lo:104: 00000100:00100000:3.0:1787836387.987989:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836387.988251:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787836387.988279:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836387.988292:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193151232 00000100:00100000:1.0:1787836387.988299:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193151232 00000100:00100000:1.0:1787836387.988351:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193151360 00000100:00100000:1.0:1787836387.988354:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193151360 00000100:00100000:1.0:1787836387.988366:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193151488 00000100:00100000:1.0:1787836387.988368:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193151488 00000100:00100000:1.0:1787836387.988383:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787836387.988391:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:8511:x1874682193151232:12345-0@lo:104: 00010000:00010000:1.0:1787836387.988403:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988458:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787836387.988464:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:8511:x1874682193151232:12345-0@lo:104: Request processed in 74us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836387.988471:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787836387.988492:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787836387.988498:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ffd85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:8511:x1874682193151360:12345-0@lo:104: 00010000:00010000:1.0:1787836387.988506:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988541:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787836387.988546:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ffd85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:8511:x1874682193151360:12345-0@lo:104: Request processed in 49us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836387.988551:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787836387.988580:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787836387.988586:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:8511:x1874682193151488:12345-0@lo:104: 00010000:00010000:1.0:1787836387.988594:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988635:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787836387.988641:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:8511:x1874682193151488:12345-0@lo:104: Request processed in 55us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836387.988647:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787836387.988665:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787836387.988671:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988677:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a000 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836387.988682:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988690:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836387.988698:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836387.988703:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787836387.988728:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988735:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836387.988755:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988762:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c152a000/0x966835ea68ab7391 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7398 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988787:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836387.988802:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988808:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e40216c600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836387.988811:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988818:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836387.988825:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836387.988834:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787836387.988848:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988854:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836387.988860:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988866:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e40216c600/0x966835ea68ab7336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab733d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988876:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836387.988878:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988892:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c13a1400 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836387.988895:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988902:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836387.988907:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836387.988912:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787836387.988925:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988931:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836387.988947:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988953:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c13a1400/0x966835ea68ab72b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab72bf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.988966:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836387.988968:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836387.988970:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836387.988976:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836387.988981:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836387.988991:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193151616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836387.989022:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836387.989054:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836387.989091:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193151744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836387.989113:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836387.989155:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193151872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836387.989175:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836387.989203:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193151616 00000100:00100000:1.0:1787836387.989207:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193151616 00010000:00010000:1.0:1787836387.989225:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7391 expref: 19 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836387.989244:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193151744 00000100:00100000:1.0:1787836387.989246:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193151744 00010000:00010000:1.0:1787836387.989257:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7336 expref: 20 pid: 5833 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836387.989270:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193151872 00000100:00100000:1.0:1787836387.989273:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193151872 00010000:00010000:1.0:1787836387.989280:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c13a0800/0x966835ea68ab72bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 21 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836387.989290:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787836387.989295:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+21:3312:x1874682193151616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787836387.989305:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836387.989310:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7391 expref: 21 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.989318:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7391 expref: 21 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.989333:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836387.989358:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+21:3312:x1874682193151616:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836387.989369:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787836387.989382:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787836387.989388:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+20:3312:x1874682193151744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787836387.989395:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836387.989400:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7336 expref: 20 pid: 5833 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.989407:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7336 expref: 20 pid: 5833 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.989417:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836387.989438:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+20:3312:x1874682193151744:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836387.989444:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787836387.989455:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787836387.989460:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193151872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787836387.989467:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836387.989471:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c13a0800/0x966835ea68ab72bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 19 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.989479:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c13a0800/0x966835ea68ab72bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 19 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.989488:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836387.989514:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193151872:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836387.989520:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787836387.989561:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193151872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836387.989592:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193151744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836387.989598:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193151616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787836387.990926:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c152a800/0x966835ea68ab7398 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7391 expref: 18 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836387.990942:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874682193151232:0@lo:104: 00010000:00010000:3.0:1787836387.990951:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e40216c400/0x966835ea68ab733d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7336 expref: 17 pid: 5833 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836387.990959:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874682193151360:0@lo:104: 00010000:00010000:3.0:1787836387.990967:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c13a0800/0x966835ea68ab72bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab72b8 expref: 16 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836387.990991:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874682193151488:0@lo:104: 00000100:00100000:1.0:1787836387.992095:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1874682193151104:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836387.992139:0:8511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836387.994266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836387.994330:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172151424 00000100:00100000:1.0:1787836387.994347:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172151424 00010000:00010000:1.0:1787836387.994380:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836387.994418:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:1.0:1787836387.994427:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172151424:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836387.994440:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836387.994446:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994457:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994475:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13aca00/0x966835ea68ab7455 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd8b expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994490:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994497:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994523:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994530:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994549:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994556:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994561:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad800 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836387.994564:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994571:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994585:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836387.994594:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836387.994640:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:2363:x1874682172151424:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 215us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836387.994647:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00010000:00010000:3.0:1787836387.995524:0:8511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.995536:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836387.995544:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ad800/0x966835ea68ab74f6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836388.528972:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836389.102762:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836389.102784:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193152000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836389.102844:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.102908:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193152000 00000100:00100000:2.0:1787836389.102914:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193152000 00000100:00100000:2.0:1787836389.102962:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787836389.102970:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193152000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836389.103000:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836389.103040:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193152000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.103047:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787836389.103080:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787836389.103108:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fae82d00 x1874682193152000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836389.103135:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193152000:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1787836389.230185:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787836389.230193:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e2c1c4b800 from 4 10000000:01000000:3.0:1787836389.230198:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787836389.230308:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836389.230321:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836389.230332:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836389.230355:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787836389.230415:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836389.230457:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99300 going to sleep for 11 seconds 00000100:00100000:1.0:1787836389.231167:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193152128 00000100:00100000:1.0:1787836389.231177:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193152128 00000100:00100000:1.0:1787836389.231230:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787836389.231239:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193152128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787836389.231267:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836389.231284:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab74fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836389.231307:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab74fd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836389.231318:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab74fd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836389.231326:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5600, rc 0) 00000100:00100000:1.0:1787836389.231383:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193152128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836389.231391:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787836389.231959:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836389.231979:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836389.232006:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836389.232101:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836389.232395:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836389.232429:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99300 going to sleep for 11 seconds 00000100:00100000:0.0:1787836389.233329:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193152256 00000100:00100000:0.0:1787836389.233336:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193152256 00000100:00100000:0.0:1787836389.233377:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787836389.233384:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193152256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836389.233648:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193152256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836389.233657:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787836389.233681:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.233726:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.233767:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.233804:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d85833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836389.233848:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193152384 00000100:00100000:0.0:1787836389.233852:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193152384 00000100:00100000:0.0:1787836389.233893:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787836389.233899:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193152384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836389.234037:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193152384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836389.234045:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787836389.234163:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.238329:0:8557:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8557:1874682193152512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.238419:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.238460:0:8557:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836389.238564:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193152512 00000100:00100000:0.0:1787836389.238578:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193152512 00000100:00100000:0.0:1787836389.238626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787836389.238634:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:8557:x1874682193152512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836389.238869:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:8557:x1874682193152512:12345-0@lo:502:llog_process_th.0 Request processed in 235us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836389.238877:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787836389.238920:0:8557:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8557:1874682193152512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787836389.238952:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836389.238961:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836389.238963:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787836389.238970:0:8557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e2c1c4b800 00000020:00000080:1.0:1787836389.238972:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787836389.239341:0:8557:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8557:1874682193152640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836389.239384:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836389.239465:0:8557:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce37c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.243290:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193152640 00000100:00100000:2.0:1787836389.243306:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193152640 00000100:00100000:2.0:1787836389.243430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787836389.243443:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:8557:x1874682193152640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.243753:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:8557:x1874682193152640:12345-0@lo:502:llog_process_th.0 Request processed in 312us (4367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.243762:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787836389.255149:0:8557:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8557:1874682193152640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787836389.255200:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836389.255210:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836389.255212:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787836389.255217:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787836389.255599:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787836389.255626:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787836389.255640:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836389.255670:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836389.255683:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787836389.255686:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3d01b2000 from 4 10000000:01000000:1.0:1787836389.255689:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787836389.255742:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836389.255750:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836389.255761:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836389.255787:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787836389.255867:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836389.255923:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce37cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.257649:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193152768 00000100:00100000:2.0:1787836389.257662:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193152768 00000100:00100000:2.0:1787836389.257717:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787836389.257729:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193152768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836389.257748:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836389.257768:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab750b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.257799:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab750b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.257813:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab750b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.257829:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005be00, rc 0) 00000100:00100000:2.0:1787836389.257910:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193152768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.257918:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787836389.257999:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836389.258021:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.258031:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836389.258145:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.258182:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.258212:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583600 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.258226:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193152896 00000100:00100000:2.0:1787836389.258229:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193152896 00000100:00100000:2.0:1787836389.258251:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787836389.258257:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193152896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.258796:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193152896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 535us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.258804:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787836389.258882:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193152896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836389.258917:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193153024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836389.258955:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836389.258988:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.259098:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193153024 00000100:00100000:2.0:1787836389.259104:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193153024 00000100:00100000:2.0:1787836389.259145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787836389.259153:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193153024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.259314:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193153024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.259320:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787836389.259357:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193153024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836389.264451:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8562:1874682193153152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836389.264547:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836389.264592:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec300 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.264782:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193153152 00000100:00100000:2.0:1787836389.264791:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193153152 00000100:00100000:2.0:1787836389.264879:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787836389.264891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:8562:x1874682193153152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.265185:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:8562:x1874682193153152:12345-0@lo:502:llog_process_th.0 Request processed in 296us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.265194:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787836389.269582:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8562:1874682193153152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787836389.269628:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787836389.269642:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836389.269644:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787836389.269651:0:8562:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e3d01b2000 00000020:00000080:2.0:1787836389.269654:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787836389.269765:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8562:1874682193153280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.269840:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.269880:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193153280 00000100:00100000:2.0:1787836389.269886:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193153280 00000100:00100000:2.0:1787836389.269930:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787836389.269938:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:8562:x1874682193153280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.270235:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:8562:x1874682193153280:12345-0@lo:502:llog_process_th.0 Request processed in 296us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.270253:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787836389.272718:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d85833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.272756:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8562:1874682193153280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787836389.272798:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836389.272807:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836389.272810:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787836389.272816:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787836389.280779:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787836389.280822:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787836389.280838:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836389.280854:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836389.280868:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787836389.280872:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3ce1d0800 from 4 10000000:01000000:3.0:1787836389.280875:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787836389.280921:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836389.280931:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836389.280942:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836389.280985:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193153408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787836389.281093:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836389.281149:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99600 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.291921:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193153408 00000100:00100000:2.0:1787836389.291941:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193153408 00000100:00100000:2.0:1787836389.292018:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787836389.292028:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193153408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836389.292046:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836389.292096:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab7519 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.292134:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab7519 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.292146:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7519 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.292155:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a800, rc 0) 00000100:00100000:2.0:1787836389.292232:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193153408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (11176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.292239:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787836389.292327:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193153408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836389.292346:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.292367:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836389.292456:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193153536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.292496:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.292529:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583600 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.292543:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193153536 00000100:00100000:2.0:1787836389.292546:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193153536 00000100:00100000:2.0:1787836389.292569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787836389.292576:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193153536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.292863:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193153536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.292871:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787836389.292907:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193153536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.292940:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193153664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.292979:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.292992:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583600 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.293004:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193153664 00000100:00100000:2.0:1787836389.293008:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193153664 00000100:00100000:2.0:1787836389.293030:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787836389.293035:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193153664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.293212:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193153664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.293219:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787836389.293263:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193153664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836389.293439:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8567:1874682193153792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.293477:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.293497:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193153792 00000100:00100000:2.0:1787836389.293500:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193153792 00000100:00100000:2.0:1787836389.293522:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787836389.293528:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:8567:x1874682193153792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.293656:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:8567:x1874682193153792:12345-0@lo:502:llog_process_th.0 Request processed in 128us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.293663:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787836389.293698:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583600 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.293711:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8567:1874682193153792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787836389.293738:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787836389.293749:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836389.293752:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787836389.293759:0:8567:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e3ce1d0800 00000020:00000080:2.0:1787836389.293761:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787836389.293842:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8567:1874682193153920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.293874:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836389.293892:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193153920 00000100:00100000:2.0:1787836389.293895:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193153920 00000100:00100000:2.0:1787836389.293912:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787836389.293918:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:8567:x1874682193153920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836389.294006:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:8567:x1874682193153920:12345-0@lo:502:llog_process_th.0 Request processed in 88us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.294013:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787836389.294040:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d114b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787836389.294050:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:8567:1874682193153920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787836389.294126:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836389.294130:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836389.294131:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787836389.294135:0:8567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787836389.294177:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787836389.294192:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787836389.294201:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.294210:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836389.419454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836389.422930:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172151552 00000100:00100000:2.0:1787836389.422949:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172151552 00000100:00100000:2.0:1787836389.423015:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:2.0:1787836389.423027:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:5601:x1874682172151552:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836389.423048:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836389.423085:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000eddca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.423122:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.423134:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836389.423144:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836389.423221:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5601:x1874682172151552:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 196us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.423229:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:0.0:1787836389.432220:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836389.440943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172151680 00000100:00100000:2.0:1787836389.440964:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172151680 00000100:00100000:3.0:1787836389.443478:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:3.0:1787836389.443493:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5601:x1874682172151680:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836389.443935:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5601:x1874682172151680:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 444us (11723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836389.443944:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:2.0:1787836389.453570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836389.453697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172151808 00000100:00100000:1.0:1787836389.453709:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172151808 00000100:00100000:1.0:1787836389.453776:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:1.0:1787836389.453787:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5601:x1874682172151808:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787836389.454046:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:5601:x1874682172151808:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 260us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836389.454083:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:1.0:1787836389.465322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836389.468009:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172151936 00000100:00100000:3.0:1787836389.468022:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172151936 00000100:00100000:2.0:1787836389.468235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 191 00000100:00100000:2.0:1787836389.468245:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:6149:x1874682172151936:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787836389.468681:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:6149:x1874682172151936:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 434us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836389.468690:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 191 00000100:00100000:1.0:1787836389.495266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836389.495358:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172152064 00000100:00100000:3.0:1787836389.495370:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172152064 00000100:00100000:3.0:1787836389.495436:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 192 00000100:00100000:3.0:1787836389.495448:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:6149:x1874682172152064:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787836389.495746:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:6149:x1874682172152064:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 300us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836389.495766:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 192 00010000:00010000:1.0:1787836389.563312:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836389.999967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836390.000018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836390.000052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836390.000114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836390.000154:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172152448 00000100:00100000:2.0:1787836390.000166:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172152448 00000100:00100000:2.0:1787836390.000248:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172152576 00000100:00100000:2.0:1787836390.000252:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172152576 00000100:00100000:2.0:1787836390.000280:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:2.0:1787836390.000291:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172152448:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836390.000387:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172152448:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 98us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836390.000395:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:2.0:1787836390.000413:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836390.000419:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172152576:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836390.000457:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172152576:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 38us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836390.000464:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836390.000484:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172152320 00000100:00100000:2.0:1787836390.000487:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172152320 00000100:00100000:2.0:1787836390.000518:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:2.0:1787836390.000525:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172152320:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836390.000553:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172152320:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836390.000559:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00080000:2.0:1787836390.000578:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787836390.000582:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787836390.000584:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836390.002880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172152192 00000100:00100000:3.0:1787836390.002901:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172152192 00000100:00100000:3.0:1787836390.002989:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 193 00000100:00100000:3.0:1787836390.003001:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172152192:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836390.003127:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172152192:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 127us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836390.003136:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 193 00010000:00010000:1.0:1787836390.574426:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836391.600739:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836392.177263:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193154048:0@lo:400:kworker.0 00000100:00100000:1.0:1787836392.177333:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836392.179168:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193154048 00000100:00100000:3.0:1787836392.179180:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193154048 00000100:00100000:3.0:1787836392.179243:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787836392.179261:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193154048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183310:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193154432:0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183373:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836392.183411:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787836392.183417:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193154304:0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183443:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836392.183472:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193154432 00000100:00100000:0.0:1787836392.183478:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193154432 00000100:00100000:0.0:1787836392.183531:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787836392.183540:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193154432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183588:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193154432:12345-0@lo:400:kworker.0 Request processed in 50us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836392.183605:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787836392.183628:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193154304 00000100:00100000:0.0:1787836392.183631:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193154304 00000100:00100000:0.0:1787836392.183654:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787836392.183661:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193154304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183691:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193154304:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836392.183696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787836392.183712:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787836392.183716:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836392.183748:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193154304:0@lo:400:kworker.0 00010000:00080000:0.0:1787836392.183765:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf30c0 x1874682193154432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836392.183774:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193154432:0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183812:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193154176:0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183836:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836392.183855:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193154688:0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183873:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836392.183891:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787836392.183896:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193154560:0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.183916:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836392.183937:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193154176 00000100:00100000:0.0:1787836392.183941:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193154176 00000100:00100000:0.0:1787836392.183960:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193154560 00000100:00100000:0.0:1787836392.183963:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193154560 00000100:00100000:0.0:1787836392.183994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787836392.184000:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193154176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.184034:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193154176:12345-0@lo:400:kworker.0 Request processed in 35us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836392.184040:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787836392.184053:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787836392.184081:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193154560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.184120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193154560:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836392.184126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787836392.184145:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193154688 00000100:00100000:0.0:1787836392.184148:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193154688 00000100:00100000:0.0:1787836392.184169:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787836392.184174:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193154688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.184201:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193154688:12345-0@lo:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836392.184206:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787836392.184220:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787836392.184222:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836392.184238:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193154560:0@lo:400:kworker.0 00000100:00100000:0.0:1787836392.184248:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193154176:0@lo:400:kworker.0 00010000:00080000:0.0:1787836392.184256:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf3c00 x1874682193154688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836392.184265:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193154688:0@lo:400:kworker.0 00000100:00100000:3.0:1787836392.188227:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193154048:12345-0@lo:400:kworker.0 Request processed in 8959us (10884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836392.188241:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787836392.188382:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193154048:0@lo:400:kworker.0 00010000:00010000:1.0:1787836392.623017:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836392.691380:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193154816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836392.691638:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836392.691770:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193154816 00000100:00100000:2.0:1787836392.691790:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193154816 00000100:00100000:2.0:1787836392.691848:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836392.691858:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193154816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836392.691893:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836392.691943:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193154816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836392.691950:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787836392.692109:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d1b480 x1874682193154816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836392.692127:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193154816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836393.652358:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836394.226881:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193154944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836394.226963:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836394.227053:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193154944 00000100:00100000:3.0:1787836394.227086:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193154944 00000100:00100000:3.0:1787836394.227150:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787836394.227160:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193154944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787836394.227201:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836394.227251:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193154944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836394.227258:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787836394.227258:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787836394.227311:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fbbc00 x1874682193154944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836394.227334:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193154944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787836394.670246:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836395.030779:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787836395.121806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836395.121869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836395.121895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836395.121924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836395.121957:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172152704 00000100:00100000:3.0:1787836395.121969:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172152704 00000100:00100000:3.0:1787836395.122033:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 195 00000100:00100000:3.0:1787836395.122105:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172152704:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836395.122189:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172152704:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836395.122196:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 195 00000100:00100000:3.0:1787836395.122239:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172152960 00000100:00100000:3.0:1787836395.122245:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172152960 00000100:00100000:3.0:1787836395.122293:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172153088 00000100:00100000:3.0:1787836395.122297:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172153088 00000100:00100000:3.0:1787836395.122321:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:3.0:1787836395.122329:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172152960:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836395.122363:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172152960:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 36us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836395.122370:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:3.0:1787836395.122385:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:3.0:1787836395.122393:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172153088:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836395.122418:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172153088:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836395.122436:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00080000:3.0:1787836395.122473:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787836395.122481:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836395.124110:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172152832 00000100:00100000:1.0:1787836395.124122:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172152832 00000100:00100000:1.0:1787836395.124192:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:1.0:1787836395.124212:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172152832:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836395.124298:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172152832:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 91us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836395.124306:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00080000:3.0:1787836395.124595:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787836395.694304:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836396.734704:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836397.295354:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193155072:0@lo:400:kworker.0 00000100:00100000:1.0:1787836397.295392:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193155456:0@lo:400:kworker.0 00000100:00100000:3.0:1787836397.295480:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193155328:0@lo:400:kworker.0 00000100:00100000:0.0:1787836397.295552:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193155200:0@lo:400:kworker.0 00000100:00100000:2.0:1787836397.296674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836397.296674:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836397.296765:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836397.296768:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193155584:0@lo:400:kworker.0 00000100:00100000:1.0:1787836397.296791:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193155456 00000100:00100000:1.0:1787836397.296821:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193155456 00000100:00100000:2.0:1787836397.296856:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193155072 00000100:00100000:2.0:1787836397.296869:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193155072 00000100:00100000:2.0:1787836397.296915:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787836397.296926:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193155072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836397.296984:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787836397.296993:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193155456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836397.297116:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193155328 00000100:00100000:1.0:1787836397.297147:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193155456:12345-0@lo:400:kworker.0 Request processed in 156us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836397.297156:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787836397.297246:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787836397.297291:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d1a1c0 x1874682193155456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836397.297294:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193155328 00000100:00100000:1.0:1787836397.297311:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193155456:0@lo:400:kworker.0 00000100:00080000:1.0:1787836397.297337:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836397.297346:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787836397.297356:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193155328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836397.297373:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836397.297405:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193155712:0@lo:400:kworker.0 00000100:00100000:0.0:1787836397.297408:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193155328:12345-0@lo:400:kworker.0 Request processed in 54us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836397.297418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787836397.297430:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193155200 00000100:00100000:0.0:1787836397.297433:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193155200 00000100:00100000:2.0:1787836397.297435:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193155072:12345-0@lo:400:kworker.0 Request processed in 511us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836397.297442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787836397.297448:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787836397.297452:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193155200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836397.297480:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193155200:12345-0@lo:400:kworker.0 Request processed in 26us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836397.297485:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787836397.297488:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193155328:0@lo:400:kworker.0 00000100:00100000:1.0:1787836397.297521:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836397.297563:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193155200:0@lo:400:kworker.0 00000100:00100000:3.0:1787836397.297673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836397.297709:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193155072:0@lo:400:kworker.0 00000100:00100000:0.0:1787836397.297884:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193155712 00000100:00100000:0.0:1787836397.297889:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193155712 00000100:00100000:0.0:1787836397.297936:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787836397.297943:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193155712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836397.297982:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193155712:12345-0@lo:400:kworker.0 Request processed in 39us (460us total) trans 0 rc 0/0 00000100:00080000:1.0:1787836397.297997:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787836397.298122:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d1a940 x1874682193155712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836397.298136:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193155712:0@lo:400:kworker.0 00000100:00100000:2.0:1787836397.298526:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193155584 00000100:00100000:2.0:1787836397.298533:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193155584 00000100:00100000:2.0:1787836397.298581:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787836397.298586:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836397.298591:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193155584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836397.298647:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193155584:12345-0@lo:400:kworker.0 Request processed in 59us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836397.298653:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787836397.298736:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787836397.298782:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193155584:0@lo:400:kworker.0 00010000:00010000:2.0:1787836397.742169:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836397.806377:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193155840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836397.806455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836397.806580:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193155840 00000100:00100000:1.0:1787836397.806588:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193155840 00000100:00100000:1.0:1787836397.806645:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787836397.806654:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193155840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787836397.806699:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836397.806749:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193155840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836397.806757:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787836397.806801:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d19680 x1874682193155840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836397.806820:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193155840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836398.782389:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836399.343234:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836399.343261:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193155968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836399.343337:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836399.343420:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193155968 00000100:00100000:0.0:1787836399.343428:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193155968 00000100:00100000:0.0:1787836399.343509:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787836399.343519:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193155968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836399.343554:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836399.343605:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193155968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836399.343612:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787836399.343637:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787836399.343671:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d144a940 x1874682193155968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836399.343691:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193155968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787836399.792253:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836400.234318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836400.234407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172153216 00000100:00100000:3.0:1787836400.234417:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172153216 00000100:00100000:3.0:1787836400.234480:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 197 00000100:00100000:3.0:1787836400.234490:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172153216:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836400.234559:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172153216:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 71us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836400.234566:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 197 00000100:00100000:1.0:1787836400.237263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836400.237341:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172153344 00000100:00100000:3.0:1787836400.237350:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172153344 00000100:00100000:3.0:1787836400.237417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:3.0:1787836400.237429:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2363:x1874682172153344:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836400.237498:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2363:x1874682172153344:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 73us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836400.237505:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00080000:1.0:1787836400.237564:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836400.244749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836400.244832:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172153472 00000100:00100000:3.0:1787836400.244842:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172153472 00000100:00100000:3.0:1787836400.244917:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:3.0:1787836400.244927:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2360:x1874682172153472:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:3.0:1787836400.244976:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7463 00000100:00080000:3.0:1787836400.244987:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98e401e68000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787836400.245026:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787836400.245401:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+2:2360:x1874682172153472:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 474us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836400.245409:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00010000:00010000:3.0:1787836400.245459:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787836400.245593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836400.247871:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836400.247906:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172153600 00000100:00100000:3.0:1787836400.247914:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172153600 00000100:00080000:1.0:1787836400.248074:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787836400.248141:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:3.0:1787836400.248154:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2360:x1874682172153600:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:3.0:1787836400.248187:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab746a 00000100:00080000:3.0:1787836400.248197:0:6691:0:(import.c:65:import_set_state_nolock()) ffff98e401e6e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787836400.248235:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787836400.248543:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+2:2360:x1874682172153600:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 391us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836400.248550:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00010000:00010000:1.0:1787836400.248662:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836400.818197:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836401.408587:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing yml_node 00000001:00100000:3.0:1787836401.446104:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:3.0:1787836401.446115:0:6718:0:(genops.c:885:class_export_put()) final put ffff98e401e6f000/2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:3.0:1787836401.446143:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98e401e6f000/2cd520e4-f240-41e5-b585-08ee5ec96478 for lustre-OST0000 00000020:00000080:3.0:1787836401.446190:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e401e68000 for lustre-OST0000 00010000:00010000:3.0:1787836401.839516:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836402.415301:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193156096:0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.415382:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836402.415444:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836402.415450:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193156224:0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.415480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836402.415514:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193156096 00000100:00100000:1.0:1787836402.415521:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193156096 00000100:00100000:1.0:1787836402.415578:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787836402.415587:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193156096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.415659:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193156096:12345-0@lo:400:kworker.0 Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836402.415685:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787836402.415727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193156224 00000100:00100000:1.0:1787836402.415732:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193156224 00000100:00100000:1.0:1787836402.415759:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787836402.415766:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193156224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.415799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193156224:12345-0@lo:400:kworker.0 Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836402.415804:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787836402.415848:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193156224:0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.415858:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193156096:0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.419886:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193156352:0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.419955:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836402.420028:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193156352 00000100:00100000:1.0:1787836402.420035:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193156352 00000100:00100000:1.0:1787836402.420101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787836402.420112:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193156352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.420165:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193156352:12345-0@lo:400:kworker.0 Request processed in 56us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836402.420172:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787836402.420196:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836402.420227:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193156352:0@lo:400:kworker.0 00000100:00100000:0.0:1787836402.420438:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787836402.420492:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193156608:0@lo:400:kworker.0 00000100:00100000:0.0:1787836402.420529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836402.420567:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193156736:0@lo:400:kworker.0 00000100:00100000:0.0:1787836402.420591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836402.420895:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193156608 00000100:00100000:1.0:1787836402.420900:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193156608 00000100:00100000:1.0:1787836402.420948:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787836402.420953:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193156608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.421009:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193156608:12345-0@lo:400:kworker.0 Request processed in 55us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836402.421025:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787836402.421042:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836402.421072:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836402.421079:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193156480:0@lo:400:kworker.0 00000100:00100000:0.0:1787836402.421307:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193156608:0@lo:400:kworker.0 00000100:00100000:0.0:1787836402.421331:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193156736 00000100:00100000:0.0:1787836402.421335:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193156736 00000100:00100000:0.0:1787836402.421370:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787836402.421376:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193156736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836402.421413:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193156736:12345-0@lo:400:kworker.0 Request processed in 37us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836402.421419:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787836402.421432:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787836402.421448:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf0b40 x1874682193156736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836402.421469:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193156736:0@lo:400:kworker.0 00000100:00100000:1.0:1787836402.421532:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836402.421907:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193156480 00000100:00100000:0.0:1787836402.421912:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193156480 00000100:00100000:0.0:1787836402.421950:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787836402.421958:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193156480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836402.422015:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193156480:12345-0@lo:400:kworker.0 Request processed in 57us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836402.422029:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787836402.422077:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf2940 x1874682193156480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836402.422088:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193156480:0@lo:400:kworker.0 00000100:00080000:1.0:1787836402.432185:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787836402.866628:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836402.934920:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193156864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787836402.935008:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836402.935361:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193156864 00000100:00100000:0.0:1787836402.935370:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193156864 00000100:00100000:0.0:1787836402.935429:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787836402.935439:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193156864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836402.935476:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836402.935525:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193156864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836402.935532:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787836402.935651:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf2940 x1874682193156864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836402.935671:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193156864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787836403.886686:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836404.466536:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d14492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193156992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836404.466615:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836404.466813:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193156992 00000100:00100000:0.0:1787836404.466821:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193156992 00000100:00100000:0.0:1787836404.466869:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787836404.466878:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193156992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836404.466908:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836404.466951:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193156992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836404.466965:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787836404.466997:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787836404.467028:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d14492c0 x1874682193156992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836404.467046:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d14492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193156992:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787836404.520596:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:3.0:1787836404.520605:0:7644:0:(genops.c:885:class_export_put()) final put ffff98e401e6d800/2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:1.0:1787836404.521094:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e401e6d800/2cd520e4-f240-41e5-b585-08ee5ec96478 for lustre-OST0001 00000020:00000080:1.0:1787836404.521304:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e401e6e800 for lustre-OST0001 00010000:00010000:3.0:1787836404.912104:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836405.364597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836405.364662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836405.364749:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172153856 00000100:00100000:3.0:1787836405.364760:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172153856 00000100:00100000:3.0:1787836405.364855:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:3.0:1787836405.364867:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172153856:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836405.364966:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172153856:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 101us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836405.364973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:0.0:1787836405.365631:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172153728 00000100:00100000:0.0:1787836405.365638:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172153728 00000100:00100000:0.0:1787836405.365683:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 199 00000100:00100000:0.0:1787836405.365692:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2364:x1874682172153728:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836405.365744:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2364:x1874682172153728:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 54us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836405.365751:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 199 00000100:00080000:1.0:1787836405.366120:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787836405.944527:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787836406.807025:0:9249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.97 00010000:00010000:0.0:1787836406.960218:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836407.535553:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193157248:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.535709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836407.535764:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193157760:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.535791:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836407.535824:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787836407.535830:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193157120:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.535855:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836407.535876:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193157632:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.535897:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836407.535923:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193157376:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.535945:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836407.535972:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836407.535977:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193157504:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536009:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836407.536040:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193157248 00000100:00100000:0.0:1787836407.536047:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193157248 00000100:00100000:0.0:1787836407.536122:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193157632 00000100:00100000:0.0:1787836407.536125:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193157632 00000100:00100000:0.0:1787836407.536146:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193157376 00000100:00100000:0.0:1787836407.536149:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193157376 00000100:00100000:0.0:1787836407.536163:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787836407.536170:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193157248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536217:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193157248:12345-0@lo:400:kworker.0 Request processed in 46us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836407.536223:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787836407.536239:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787836407.536244:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193157632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536269:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193157632:12345-0@lo:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836407.536274:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787836407.536286:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787836407.536291:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193157376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536319:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193157376:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836407.536324:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787836407.536343:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193157760 00000100:00100000:0.0:1787836407.536347:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193157760 00000100:00100000:0.0:1787836407.536370:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193157504 00000100:00100000:0.0:1787836407.536373:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193157504 00000100:00100000:0.0:1787836407.536395:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787836407.536401:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193157760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536432:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193157760:12345-0@lo:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836407.536438:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787836407.536449:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787836407.536455:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193157504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536480:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193157504:12345-0@lo:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836407.536485:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787836407.536520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193157120 00000100:00100000:0.0:1787836407.536524:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193157120 00000100:00100000:0.0:1787836407.536549:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787836407.536555:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193157120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536583:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193157120:12345-0@lo:400:kworker.0 Request processed in 28us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836407.536589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1787836407.536619:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787836407.536623:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787836407.536625:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787836407.536655:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf12c0 x1874682193157504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836407.536668:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193157504:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536680:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193157376:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536708:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193157120:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536730:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193157632:0@lo:400:kworker.0 00000100:00100000:0.0:1787836407.536738:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193157248:0@lo:400:kworker.0 00010000:00080000:0.0:1787836407.536747:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf2940 x1874682193157760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836407.536755:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193157760:0@lo:400:kworker.0 00010000:00010000:3.0:1787836407.983609:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836408.046505:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193157888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836408.046595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836408.047086:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193157888 00000100:00100000:0.0:1787836408.047096:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193157888 00000100:00100000:2.0:1787836408.047253:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787836408.047266:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193157888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836408.047304:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836408.047367:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193157888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836408.047374:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787836408.047553:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc1680 x1874682193157888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836408.047572:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193157888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836409.007409:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836409.339540:0:9346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.97 00000100:00100000:1.0:1787836409.590593:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836409.590620:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193158016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836409.590865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836409.596875:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193158016 00000100:00100000:0.0:1787836409.596891:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193158016 00000100:00100000:0.0:1787836409.597557:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787836409.597568:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193158016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836409.597609:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836409.597713:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193158016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (6848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836409.597720:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787836409.597955:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fb83c0 x1874682193158016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836409.597987:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193158016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787836409.600465:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787836410.031219:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836410.482679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836410.482741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836410.482799:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172154112 00000100:00100000:3.0:1787836410.482811:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172153984 00000100:00100000:2.0:1787836410.482811:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172154112 00000100:00100000:3.0:1787836410.482814:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172153984 00000100:00100000:3.0:1787836410.482862:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 201 00000100:00100000:2.0:1787836410.482865:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:3.0:1787836410.482872:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2362:x1874682172153984:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836410.482872:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172154112:12345-192.168.203.25@tcp:400:kworker.0 00000100:00080000:1.0:1787836410.482935:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836410.482992:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2362:x1874682172153984:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 122us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836410.483004:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 201 00000100:00100000:2.0:1787836410.488123:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172154112:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 5241us (5370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836410.488137:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00010000:00010000:3.0:1787836411.056298:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836412.080032:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836412.116751:0:9443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.97 00000100:00100000:1.0:1787836412.655939:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193158144:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836412.656131:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193158656:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656175:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836412.656218:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787836412.656225:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193158272:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836412.656269:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193158784:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656299:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836412.656358:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193158144 00000100:00100000:1.0:1787836412.656366:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193158144 00000100:00100000:1.0:1787836412.656412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787836412.656421:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193158144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656475:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193158144:12345-0@lo:400:kworker.0 Request processed in 55us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836412.656483:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787836412.656529:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193158528:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656551:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836412.656569:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836412.656575:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193158400:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656613:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836412.656652:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193158144:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656680:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193158784 00000100:00100000:1.0:1787836412.656695:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193158784 00000100:00100000:1.0:1787836412.656731:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193158528 00000100:00100000:1.0:1787836412.656734:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193158528 00000100:00100000:1.0:1787836412.656762:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787836412.656769:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193158784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656805:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193158784:12345-0@lo:400:kworker.0 Request processed in 37us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836412.656812:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787836412.656823:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787836412.656829:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193158528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656858:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193158528:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836412.656864:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787836412.656879:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836412.656883:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787836412.656901:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fbb840 x1874682193158528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836412.656914:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193158528:0@lo:400:kworker.0 00010000:00080000:1.0:1787836412.656934:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fb9e00 x1874682193158784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836412.656942:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193158784:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.656999:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193158656 00000100:00100000:1.0:1787836412.657002:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193158656 00000100:00100000:1.0:1787836412.657027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193158272 00000100:00100000:1.0:1787836412.657030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193158272 00000100:00100000:1.0:1787836412.657039:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193158400 00000100:00100000:1.0:1787836412.657041:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193158400 00000100:00100000:1.0:1787836412.657094:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787836412.657100:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193158656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.657426:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193158656:12345-0@lo:400:kworker.0 Request processed in 326us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836412.657432:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787836412.657445:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787836412.657452:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193158272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.657479:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193158272:12345-0@lo:400:kworker.0 Request processed in 28us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836412.657495:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787836412.657507:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787836412.657513:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193158400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.657546:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193158400:12345-0@lo:400:kworker.0 Request processed in 34us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836412.657552:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787836412.657568:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836412.657588:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193158400:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.657611:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193158272:0@lo:400:kworker.0 00000100:00100000:1.0:1787836412.657621:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193158656:0@lo:400:kworker.0 00010000:00010000:3.0:1787836413.103123:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836413.169456:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836413.169485:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193158912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836413.169561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836413.169957:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193158912 00000100:00100000:0.0:1787836413.169965:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193158912 00000100:00100000:0.0:1787836413.170023:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787836413.170034:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193158912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836413.170102:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836413.170175:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193158912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836413.170182:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787836413.170273:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc2940 x1874682193158912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836413.170295:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193158912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787836414.131585:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836414.161123:0:9492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 09:13:31 EDT 2026 00000100:00100000:2.0:1787836414.702275:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836414.702296:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193159040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836414.702371:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836414.702497:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193159040 00000100:00100000:2.0:1787836414.702504:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193159040 00000100:00100000:2.0:1787836414.702655:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787836414.702665:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193159040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836414.702697:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836414.702963:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193159040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 299us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836414.702972:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787836414.703623:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d144b0c0 x1874682193159040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836414.703665:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193159040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787836414.703939:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787836415.159823:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836415.596448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836415.596505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836415.596575:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172154240 00000100:00100000:1.0:1787836415.596586:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172154240 00000100:00100000:1.0:1787836415.596649:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 203 00000100:00100000:1.0:1787836415.596659:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2362:x1874682172154240:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836415.596764:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2362:x1874682172154240:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 107us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836415.596772:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 203 00000100:00100000:1.0:1787836415.596819:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172154368 00000100:00100000:1.0:1787836415.596823:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172154368 00000100:00100000:1.0:1787836415.596869:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:1.0:1787836415.596877:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172154368:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836415.596910:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172154368:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 34us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836415.596917:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00080000:1.0:1787836415.597109:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787836416.174603:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836417.198720:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836417.774406:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193159552:0@lo:400:kworker.0 00000100:00100000:2.0:1787836417.774457:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193159296:0@lo:400:kworker.0 00000100:00100000:2.0:1787836417.774512:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836417.774512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836417.774591:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193159168:0@lo:400:kworker.0 00000100:00100000:3.0:1787836417.774643:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193159424:0@lo:400:kworker.0 00000100:00100000:2.0:1787836417.776601:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193159808:0@lo:400:kworker.0 00000100:00100000:2.0:1787836417.776659:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836417.776781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836417.776806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193159296 00000100:00100000:2.0:1787836417.776814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193159296 00000100:00100000:0.0:1787836417.776835:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193159552 00000100:00100000:0.0:1787836417.776841:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193159552 00000100:00100000:2.0:1787836417.776881:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787836417.776892:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193159808 00000100:00100000:2.0:1787836417.776893:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193159296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836417.776899:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193159808 00000100:00100000:0.0:1787836417.776933:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787836417.776942:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193159552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836417.776999:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193159552:12345-0@lo:400:kworker.0 Request processed in 59us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836417.777007:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787836417.777026:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787836417.777038:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193159808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836417.780813:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193159296:12345-0@lo:400:kworker.0 Request processed in 3914us (6298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836417.780828:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787836417.784930:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193159168 00000100:00100000:2.0:1787836417.784944:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193159168 00000100:00100000:2.0:1787836417.785006:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787836417.785017:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193159168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836417.788109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836417.788234:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193159424 00000100:00100000:3.0:1787836417.788244:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193159424 00000100:00100000:3.0:1787836417.788290:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787836417.788303:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193159424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836417.788363:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193159424:12345-0@lo:400:kworker.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836417.788370:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787836417.788412:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193159424:0@lo:400:kworker.0 00000100:00100000:3.0:1787836417.789195:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193159296:0@lo:400:kworker.0 00010000:00080000:3.0:1787836417.789214:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc3c00 x1874682193159808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836417.789225:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193159808:0@lo:400:kworker.0 00000100:00080000:1.0:1787836417.790625:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787836417.790635:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836417.790638:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836417.790679:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193159680:0@lo:400:kworker.0 00000100:00100000:1.0:1787836417.790741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787836417.790838:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc30c0 x1874682193159552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836417.790852:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193159552:0@lo:400:kworker.0 00000100:00100000:2.0:1787836417.791258:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193159168:12345-0@lo:400:kworker.0 Request processed in 6240us (14474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836417.791270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787836417.791385:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193159680 00000100:00100000:3.0:1787836417.791393:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193159680 00000100:00080000:2.0:1787836417.791548:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836417.791600:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787836417.791612:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193159680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836417.791670:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193159680:12345-0@lo:400:kworker.0 Request processed in 62us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836417.791677:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787836417.791974:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193159168:0@lo:400:kworker.0 00000100:00100000:1.0:1787836417.792003:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193159680:0@lo:400:kworker.0 00000100:00100000:0.0:1787836417.792137:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193159808:12345-0@lo:400:kworker.0 Request processed in 15103us (15476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836417.792146:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1787836418.225259:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836418.287546:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836418.287570:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193159936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836418.287663:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836418.287851:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193159936 00000100:00100000:0.0:1787836418.287859:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193159936 00000100:00100000:0.0:1787836418.287926:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787836418.287936:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193159936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836418.287969:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836418.288017:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193159936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836418.288025:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787836418.288127:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc2580 x1874682193159936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836418.288146:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193159936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787836419.253607:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836419.832892:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193160064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836419.833141:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836419.833234:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193160064 00000100:00100000:2.0:1787836419.833244:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193160064 00000100:00100000:2.0:1787836419.833306:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787836419.833316:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193160064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836419.833440:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836419.833493:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193160064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836419.833502:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787836419.833524:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787836419.833552:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d1448780 x1874682193160064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836419.833587:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193160064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787836420.276533:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836420.716385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836420.716446:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836420.717153:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172154496 00000100:00100000:0.0:1787836420.717164:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172154496 00000100:00100000:0.0:1787836420.717212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 205 00000100:00100000:0.0:1787836420.717222:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2361:x1874682172154496:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836420.717286:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2361:x1874682172154496:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 66us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836420.717293:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 205 00000100:00100000:3.0:1787836420.720580:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172154624 00000100:00100000:3.0:1787836420.720598:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172154624 00000100:00100000:3.0:1787836420.720678:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:3.0:1787836420.720691:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172154624:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836420.720764:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172154624:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 77us (4387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836420.720772:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00080000:3.0:1787836420.720796:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787836421.296095:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836422.325210:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836422.897485:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193160576:0@lo:400:kworker.0 00000100:00100000:0.0:1787836422.897558:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193160192:0@lo:400:kworker.0 00000100:00100000:2.0:1787836422.897602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836422.897619:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836422.897677:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193160704:0@lo:400:kworker.0 00000100:00100000:2.0:1787836422.897686:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836422.897695:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193160448:0@lo:400:kworker.0 00000100:00100000:0.0:1787836422.897710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836422.897732:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836422.897739:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787836422.897746:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193160320:0@lo:400:kworker.0 00000100:00100000:2.0:1787836422.897780:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193160576 00000100:00100000:0.0:1787836422.897780:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836422.897790:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193160576 00000100:00100000:2.0:1787836422.897871:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787836422.897895:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193160576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836422.897965:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193160576:12345-0@lo:400:kworker.0 Request processed in 72us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836422.897974:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787836422.898001:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193160192 00000100:00100000:2.0:1787836422.898005:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193160192 00000100:00100000:2.0:1787836422.898033:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787836422.898040:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193160192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836422.898096:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193160192:12345-0@lo:400:kworker.0 Request processed in 56us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836422.898103:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787836422.898139:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193160704 00000100:00100000:2.0:1787836422.898144:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193160704 00000100:00100000:2.0:1787836422.898174:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193160448 00000100:00100000:2.0:1787836422.898177:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193160448 00000100:00100000:2.0:1787836422.898198:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787836422.898205:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193160704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836422.898253:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193160704:12345-0@lo:400:kworker.0 Request processed in 49us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836422.898259:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787836422.898271:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787836422.898276:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193160448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836422.898299:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193160448:12345-0@lo:400:kworker.0 Request processed in 24us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836422.898305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787836422.898327:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787836422.898334:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836422.898481:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193160448:0@lo:400:kworker.0 00010000:00080000:2.0:1787836422.898496:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc03c0 x1874682193160576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836422.898508:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193160576:0@lo:400:kworker.0 00000100:00100000:0.0:1787836422.898988:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193160832:0@lo:400:kworker.0 00000100:00100000:0.0:1787836422.899028:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836422.899081:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193160192:0@lo:400:kworker.0 00000100:00100000:0.0:1787836422.899096:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193160704:0@lo:400:kworker.0 00000100:00100000:0.0:1787836422.899142:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193160832 00000100:00100000:0.0:1787836422.899148:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193160832 00000100:00100000:0.0:1787836422.899272:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787836422.899280:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193160832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836422.899341:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193160832:12345-0@lo:400:kworker.0 Request processed in 61us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836422.899349:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787836422.899382:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc1a40 x1874682193160832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836422.899394:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193160832:0@lo:400:kworker.0 00000100:00080000:2.0:1787836422.899471:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836422.899482:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193160320 00000100:00100000:2.0:1787836422.899486:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193160320 00000100:00100000:2.0:1787836422.899522:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787836422.899531:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193160320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836422.899574:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193160320:12345-0@lo:400:kworker.0 Request processed in 45us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836422.899581:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787836422.899609:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193160320:0@lo:400:kworker.0 00010000:00010000:3.0:1787836423.342369:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836423.406406:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193160960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787836423.406524:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836423.406788:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193160960 00000100:00100000:2.0:1787836423.406801:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193160960 00000100:00100000:2.0:1787836423.406914:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787836423.406928:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193160960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836423.406981:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836423.407055:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193160960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836423.407105:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787836423.407295:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc1a40 x1874682193160960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836423.407318:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193160960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836424.366491:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836424.942784:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787836424.943210:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193161088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836424.943282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836424.943360:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193161088 00000100:00100000:3.0:1787836424.943368:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193161088 00000100:00100000:3.0:1787836424.943418:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787836424.943429:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193161088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787836424.943460:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836424.943519:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193161088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836424.943526:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787836424.943574:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fb83c0 x1874682193161088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836424.943593:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193161088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787836424.943635:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787836425.391529:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836425.843323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836425.843377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836425.843494:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172154752 00000100:00100000:3.0:1787836425.843508:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172154752 00000100:00100000:3.0:1787836425.843587:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 207 00000100:00100000:3.0:1787836425.843601:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172154752:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836425.843712:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172154752:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 114us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836425.843723:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 207 00000100:00100000:3.0:1787836425.843778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172154880 00000100:00100000:3.0:1787836425.843782:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172154880 00000100:00100000:3.0:1787836425.843834:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:3.0:1787836425.843842:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2363:x1874682172154880:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836425.843897:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2363:x1874682172154880:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 56us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836425.843904:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00080000:3.0:1787836425.844082:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787836426.418754:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836427.461875:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836428.016792:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193161472:0@lo:400:kworker.0 00000100:00100000:3.0:1787836428.016881:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836428.016950:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787836428.016956:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193161600:0@lo:400:kworker.0 00000100:00100000:3.0:1787836428.016984:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836428.017048:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193161600 00000100:00100000:3.0:1787836428.017055:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193161600 00000100:00100000:3.0:1787836428.017154:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787836428.017163:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193161600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836428.017212:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193161600:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836428.017218:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787836428.017241:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787836428.017266:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c1d8c000 x1874682193161600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836428.017279:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193161600:0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.017719:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193161216:0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.017755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836428.017780:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193161216 00000100:00100000:2.0:1787836428.017784:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193161216 00000100:00100000:0.0:1787836428.017784:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193161728:0@lo:400:kworker.0 00000100:00100000:2.0:1787836428.017813:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787836428.017817:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836428.017820:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193161216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.017835:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787836428.017850:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193161344:0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.017873:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836428.017891:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193161856:0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.017911:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836428.017940:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193161472 00000100:00100000:2.0:1787836428.017942:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193161216:12345-0@lo:400:kworker.0 Request processed in 122us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836428.017943:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193161472 00000100:00100000:2.0:1787836428.017948:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787836428.017968:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193161728 00000100:00100000:0.0:1787836428.017970:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193161728 00000100:00100000:0.0:1787836428.017982:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193161344 00000100:00100000:2.0:1787836428.017984:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193161216:0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.017985:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193161344 00000100:00100000:0.0:1787836428.017995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787836428.018001:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193161472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.018039:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193161472:12345-0@lo:400:kworker.0 Request processed in 37us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836428.018045:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787836428.018088:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787836428.018094:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193161728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.018126:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193161728:12345-0@lo:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836428.018131:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787836428.018141:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787836428.018147:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193161344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.018171:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193161344:12345-0@lo:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836428.018177:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787836428.018194:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193161856 00000100:00100000:2.0:1787836428.018196:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193161472:0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.018196:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193161856 00000100:00100000:0.0:1787836428.018220:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787836428.018221:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193161344:0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.018226:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193161856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836428.018229:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193161728:0@lo:400:kworker.0 00000100:00100000:0.0:1787836428.018259:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193161856:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836428.018265:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787836428.018269:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5f99680 x1874682193161856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836428.018279:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f99680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193161856:0@lo:400:kworker.0 00000100:00080000:0.0:1787836428.018285:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787836428.018288:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787836428.462354:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836428.527279:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836428.527303:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193161984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836428.527368:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836428.527425:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193161984 00000100:00100000:2.0:1787836428.527443:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193161984 00000100:00100000:2.0:1787836428.527502:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787836428.527511:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1449a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193161984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836428.527544:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836428.527600:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1449a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193161984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836428.527607:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787836428.527646:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d144b0c0 x1874682193161984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836428.527664:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193161984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787836429.486267:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836430.073160:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1449e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193162112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836430.073228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836430.073300:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193162112 00000100:00100000:2.0:1787836430.073307:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193162112 00000100:00100000:2.0:1787836430.073356:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787836430.073375:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193162112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836430.073412:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836430.073455:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193162112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836430.073462:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787836430.073481:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787836430.073506:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d1449e00 x1874682193162112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836430.073524:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1449e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193162112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787836430.510319:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836430.955780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836430.955872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836430.956025:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172155136 00000100:00100000:1.0:1787836430.956037:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172155136 00000100:00100000:1.0:1787836430.956169:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:1.0:1787836430.956295:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172155136:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836430.956702:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172155136:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 520us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836430.956713:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00080000:0.0:1787836430.956810:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836430.956913:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172155008 00000100:00100000:3.0:1787836430.956920:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172155008 00000100:00100000:3.0:1787836430.956978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 209 00000100:00100000:3.0:1787836430.956989:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2361:x1874682172155008:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836430.957033:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2361:x1874682172155008:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 47us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836430.957042:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 209 00010000:00010000:1.0:1787836431.534666:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836432.559202:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836433.135031:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193162240:0@lo:400:kworker.0 00000100:00100000:2.0:1787836433.135244:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836433.135332:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193162752:0@lo:400:kworker.0 00000100:00100000:2.0:1787836433.135378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836433.135415:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787836433.135421:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193162368:0@lo:400:kworker.0 00000100:00100000:2.0:1787836433.135445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836433.135464:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193162880:0@lo:400:kworker.0 00000100:00100000:2.0:1787836433.135486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836433.135511:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193162624:0@lo:400:kworker.0 00000100:00100000:2.0:1787836433.135775:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836433.135795:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836433.135812:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193162496:0@lo:400:kworker.0 00000100:00100000:2.0:1787836433.135836:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836433.135863:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193162752 00000100:00100000:2.0:1787836433.135870:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193162752 00000100:00100000:2.0:1787836433.135916:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193162368 00000100:00100000:2.0:1787836433.135919:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193162368 00000100:00100000:2.0:1787836433.135931:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193162496 00000100:00100000:2.0:1787836433.135933:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193162496 00000100:00100000:2.0:1787836433.135948:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787836433.135956:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193162752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836433.136136:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193162880 00000100:00100000:0.0:1787836433.136141:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193162880 00000100:00100000:0.0:1787836433.136175:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193162624 00000100:00100000:0.0:1787836433.136177:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193162624 00000100:00100000:0.0:1787836433.136192:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787836433.136200:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d14492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193162880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836433.136325:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193162240 00000100:00100000:3.0:1787836433.136332:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193162240 00000100:00100000:3.0:1787836433.136381:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787836433.136391:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193162240:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787836433.136682:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836433.136689:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836433.136694:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836433.136713:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787836433.136725:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787836433.136749:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787836433.136768:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787836433.136964:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787836433.136972:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193162624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836433.145468:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d14492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193162880:12345-0@lo:400:kworker.0 Request processed in 9256us (9968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836433.145488:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787836433.145641:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787836433.145656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1449e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193162368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836433.145730:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1449e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193162368:12345-0@lo:400:kworker.0 Request processed in 81us (10284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836433.145737:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787836433.145760:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787836433.145770:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787836433.145778:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193162496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836433.146404:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193162624:12345-0@lo:400:kworker.0 Request processed in 9428us (10624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836433.146414:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787836433.149108:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193162496:12345-0@lo:400:kworker.0 Request processed in 3317us (13257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836433.149122:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787836433.149391:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193162240:12345-0@lo:400:kworker.0 Request processed in 13001us (14146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836433.149402:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787836433.149644:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193162368:0@lo:400:kworker.0 00010000:00080000:3.0:1787836433.149662:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5f9b0c0 x1874682193162880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836433.149672:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193162880:0@lo:400:kworker.0 00000100:00100000:3.0:1787836433.149682:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193162240:0@lo:400:kworker.0 00000100:00100000:0.0:1787836433.156692:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193162496:0@lo:400:kworker.0 00010000:00080000:0.0:1787836433.156713:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5f99e00 x1874682193162624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836433.156724:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193162624:0@lo:400:kworker.0 00000100:00100000:2.0:1787836433.170314:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193162752:12345-0@lo:400:kworker.0 Request processed in 34335us (34912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836433.170331:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787836433.182683:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193162752:0@lo:400:kworker.0 00010000:00010000:3.0:1787836433.582307:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836433.646419:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1449680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193163008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836433.646500:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836433.646659:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193163008 00000100:00100000:2.0:1787836433.646668:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193163008 00000100:00100000:2.0:1787836433.646723:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787836433.646744:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193163008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836433.646790:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836433.646853:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193163008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836433.646860:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787836433.647035:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d1449680 x1874682193163008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836433.647053:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1449680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193163008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836434.616685:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787836435.094552:0:10125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:13:51 (1787836431) === 00000100:00100000:1.0:1787836435.194196:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193163136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836435.194267:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836435.195261:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193163136 00000100:00100000:2.0:1787836435.195271:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193163136 00000100:00100000:2.0:1787836435.195403:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787836435.195414:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193163136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836435.195454:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836435.195525:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193163136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.195533:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787836435.195577:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5f99a40 x1874682193163136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836435.195598:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193163136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787836435.197490:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787836435.630372:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836435.736103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836435.740405:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172155264 00000100:00100000:0.0:1787836435.740420:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172155264 00000100:00100000:0.0:1787836435.740497:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 211 00000100:00100000:0.0:1787836435.740509:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:8146:x1874682172155264:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787836435.740527:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836435.740544:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0031800/0x966835ea68ab752e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000eddd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836435.740590:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0031800/0x966835ea68ab752e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddd1 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836435.740602:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0031800/0x966835ea68ab752e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddd1 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836435.740612:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031800, rc 0) 00000100:00100000:0.0:1787836435.740686:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8146:x1874682172155264:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 180us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836435.740693:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 211 00000100:00100000:3.0:1787836435.757527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.757973:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172155392 00000100:00100000:2.0:1787836435.757983:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172155392 00000100:00100000:0.0:1787836435.758361:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 212 00000100:00100000:0.0:1787836435.758383:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8146:x1874682172155392:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787836435.758704:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8146:x1874682172155392:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 330us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836435.758712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 212 00000100:00100000:1.0:1787836435.778104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836435.778321:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172155520 00000100:00100000:3.0:1787836435.778351:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172155520 00000100:00100000:3.0:1787836435.778431:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 213 00000100:00100000:3.0:1787836435.778441:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8146:x1874682172155520:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787836435.778708:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8146:x1874682172155520:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 268us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836435.778717:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 213 00000100:00100000:3.0:1787836435.795395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.795827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172155648 00000100:00100000:2.0:1787836435.795841:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172155648 00000100:00100000:2.0:1787836435.795912:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 214 00000100:00100000:2.0:1787836435.795924:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8150:x1874682172155648:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787836435.796740:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8150:x1874682172155648:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 809us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.796757:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 214 00000100:00100000:1.0:1787836435.827657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836435.827774:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172155776 00000100:00100000:0.0:1787836435.827795:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172155776 00000100:00100000:0.0:1787836435.827857:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 215 00000100:00100000:0.0:1787836435.827868:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8150:x1874682172155776:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787836435.828225:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8150:x1874682172155776:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 358us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836435.828233:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 215 00000100:00100000:1.0:1787836435.838174:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836435.838341:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172155904 00000100:00100000:3.0:1787836435.838357:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172155904 00000100:00100000:3.0:1787836435.838427:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 216 00000100:00100000:3.0:1787836435.838438:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:8146:x1874682172155904:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787836435.838454:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836435.838476:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ade00/0x966835ea68ab7535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000eddfb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836435.838530:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ade00/0x966835ea68ab7535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddfb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836435.838541:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ade00/0x966835ea68ab7535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddfb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836435.838551:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ade00, rc 0) 00000100:00100000:3.0:1787836435.838617:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:8146:x1874682172155904:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 181us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836435.838624:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 216 00000100:00100000:0.0:1787836435.852910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.853018:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172156032 00000100:00100000:2.0:1787836435.853040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172156032 00000100:00100000:2.0:1787836435.853140:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 217 00000100:00100000:2.0:1787836435.853151:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:8146:x1874682172156032:12345-192.168.203.25@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787836435.853177:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787836435.853194:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787836435.853198:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787836435.853200:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787836435.853203:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787836435.855430:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:8146:x1874682172156032:12345-192.168.203.25@tcp:256:mount.lustre.0 Request processed in 2269us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.855444:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 217 00000100:00100000:1.0:1787836435.866736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836435.867185:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172156160 00000100:00100000:0.0:1787836435.867209:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172156160 00000100:00100000:0.0:1787836435.867303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 218 00000100:00100000:0.0:1787836435.867313:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:8146:x1874682172156160:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787836435.867330:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836435.867347:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede02 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836435.867376:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836435.867387:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836435.867397:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031600, rc 0) 00000100:00100000:0.0:1787836435.867454:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8146:x1874682172156160:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 142us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836435.867462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 218 00000100:00100000:0.0:1787836435.871804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.872471:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172156288 00000100:00100000:2.0:1787836435.872484:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172156288 00000100:00100000:2.0:1787836435.872548:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 219 00000100:00100000:2.0:1787836435.872558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8146:x1874682172156288:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787836435.873018:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8146:x1874682172156288:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 459us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.873026:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 219 00000100:00100000:1.0:1787836435.883819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836435.883917:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172156416 00000100:00100000:0.0:1787836435.883926:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172156416 00000100:00100000:0.0:1787836435.884035:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 220 00000100:00100000:0.0:1787836435.884047:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8146:x1874682172156416:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787836435.884342:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8146:x1874682172156416:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 298us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836435.884361:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 220 00000100:00100000:1.0:1787836435.889928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836435.890114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172156544 00000100:00100000:3.0:1787836435.890126:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172156544 00000100:00100000:3.0:1787836435.890191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 221 00000100:00100000:3.0:1787836435.890202:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8152:x1874682172156544:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787836435.890802:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8152:x1874682172156544:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 599us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.890811:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 221 00000100:00100000:3.0:1787836435.916570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836435.916741:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172156672 00000100:00100000:0.0:1787836435.916752:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172156672 00000100:00100000:0.0:1787836435.916844:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 222 00000100:00100000:0.0:1787836435.916855:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8152:x1874682172156672:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787836435.917128:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:8152:x1874682172156672:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 275us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836435.917136:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 222 00000100:00100000:1.0:1787836435.934539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836435.934585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.937804:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172156800 00000100:00100000:2.0:1787836435.937823:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172156800 00000100:00100000:2.0:1787836435.937881:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172157056 00000100:00100000:2.0:1787836435.937884:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172157056 00000100:00100000:2.0:1787836435.937969:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:2.0:1787836435.937981:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172157056:12345-192.168.203.25@tcp:400:kworker.0 00000100:00080000:3.0:1787836435.938028:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836435.938110:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:3.0:1787836435.938118:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1874682172156800:12345-192.168.203.25@tcp:38:mount.lustre.0 00000100:00100000:2.0:1787836435.938150:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172157056:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 170us (3563us total) trans 0 rc 0/0 00010000:00080000:3.0:1787836435.938152:0:5843:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from a64a6682-9f1f-4978-b16c-a7d486c0bf01@192.168.203.25@tcp t0 exp 0000000000000000 cur 284 last 0 00000100:00100000:2.0:1787836435.938166:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00000020:00000080:3.0:1787836435.938194:0:5843:0:(genops.c:1385:class_connect()) connect: client a64a6682-9f1f-4978-b16c-a7d486c0bf01, cookie 0x966835ea68ab7543 00000004:00100000:3.0:1787836435.938230:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1787836435.940042:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98e401e6c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787836435.940221:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2360:x1874682172156800:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 2100us (5692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.940233:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1787836435.956981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836435.959762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.963504:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172157184 00000100:00100000:2.0:1787836435.963521:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172157184 00000100:00100000:2.0:1787836435.963595:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172156928 00000100:00100000:2.0:1787836435.963599:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172156928 00000100:00100000:2.0:1787836435.963739:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:2.0:1787836435.963752:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+7:8146:x1874682172157184:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787836435.963802:0:10086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787836435.963897:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+7:8146:x1874682172157184:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 148us (6925us total) trans 0 rc 0/0 00000100:00080000:3.0:1787836435.963963:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836435.964010:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:0.0:1787836435.964022:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+7:0:x1874682172156928:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787836435.964037:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787836435.964086:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+7:0:x1874682172156928:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 68us (4332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836435.964093:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:2.0:1787836435.968442:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:0.0:1787836435.968780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.970475:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172157312 00000100:00100000:2.0:1787836435.970492:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172157312 00000100:00100000:2.0:1787836435.970568:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:2.0:1787836435.970578:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:8146:x1874682172157312:12345-192.168.203.25@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787836435.970670:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:8146:x1874682172157312:12345-192.168.203.25@tcp:40:mount.lustre.0 Request processed in 94us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.970678:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1787836435.980503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836435.980549:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.980642:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172157696 00000100:00100000:2.0:1787836435.980666:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172157696 00000100:00100000:2.0:1787836435.980719:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 223 00000100:00100000:2.0:1787836435.980730:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172157696:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836435.980818:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172157696:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.980826:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 223 00000100:00100000:3.0:1787836435.981102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172157824 00000100:00100000:3.0:1787836435.981106:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172157824 00000100:00100000:3.0:1787836435.981201:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:3.0:1787836435.981210:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172157824:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836435.981291:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172157824:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 83us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836435.981298:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:1.0:1787836435.989243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836435.989483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836435.989525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836435.989868:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172157440 00000100:00100000:2.0:1787836435.989879:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172157440 00000100:00100000:2.0:1787836435.989916:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172157568 00000100:00100000:2.0:1787836435.989919:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172157568 00000100:00100000:2.0:1787836435.989937:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:2.0:1787836435.989945:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874682172157440:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787836435.989977:0:6692:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from a64a6682-9f1f-4978-b16c-a7d486c0bf01@192.168.203.25@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:2.0:1787836435.990004:0:6692:0:(genops.c:1385:class_connect()) connect: client a64a6682-9f1f-4978-b16c-a7d486c0bf01, cookie 0x966835ea68ab754a 00002000:00100000:2.0:1787836435.990014:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a64a6682-9f1f-4978-b16c-a7d486c0bf01/ffff98e401e6d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787836435.990023:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:1.0:1787836435.990227:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:1.0:1787836435.990233:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1874682172157568:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787836435.990248:0:6693:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from a64a6682-9f1f-4978-b16c-a7d486c0bf01@192.168.203.25@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:1.0:1787836435.990263:0:6693:0:(genops.c:1385:class_connect()) connect: client a64a6682-9f1f-4978-b16c-a7d486c0bf01, cookie 0x966835ea68ab7551 00002000:00100000:1.0:1787836435.990268:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a64a6682-9f1f-4978-b16c-a7d486c0bf01/ffff98e3d01cb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787836435.990285:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787836435.990535:0:6692:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787836435.990562:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98e401e6e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787836435.990626:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2360:x1874682172157440:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 680us (2309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836435.990633:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:3.0:1787836435.990841:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172157952 00000100:00100000:3.0:1787836435.990847:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172157952 00000100:00100000:3.0:1787836435.990888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1787836435.990896:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:8146:x1874682172157952:12345-192.168.203.25@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787836435.991050:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00002000:00080000:1.0:1787836435.991323:0:6693:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787836435.991340:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98e3d01ca000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836435.992275:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2360:x1874682172157568:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 2038us (2790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836435.992285:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1787836435.992589:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:8146:x1874682172157952:12345-192.168.203.25@tcp:33:mount.lustre.0 Request processed in 1693us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836435.992598:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00010000:00010000:3.0:1787836436.654257:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787836437.363478:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a64a6682-9f1f-4978-b16c-a7d486c0bf01 00010000:00010000:0.0:1787836437.680386:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836438.255521:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193163264:0@lo:400:kworker.0 00000100:00100000:3.0:1787836438.255595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836438.255658:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193163776:0@lo:400:kworker.0 00000100:00100000:3.0:1787836438.255683:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836438.255725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193163264 00000100:00100000:3.0:1787836438.255732:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193163264 00000100:00100000:3.0:1787836438.255794:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787836438.255804:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193163264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836438.255855:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193163264:12345-0@lo:400:kworker.0 Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836438.255862:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787836438.255926:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193163264:0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256348:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193163392:0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256381:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836438.256412:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193163904:0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256451:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836438.256488:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193163520:0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256512:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836438.256529:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836438.256534:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193163648:0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256562:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836438.256588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193163776 00000100:00100000:0.0:1787836438.256592:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193163776 00000100:00100000:0.0:1787836438.256644:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193163392 00000100:00100000:0.0:1787836438.256647:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193163392 00000100:00100000:0.0:1787836438.256657:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193163520 00000100:00100000:0.0:1787836438.256660:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193163520 00000100:00100000:0.0:1787836438.256675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787836438.256681:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193163776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256720:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193163776:12345-0@lo:400:kworker.0 Request processed in 39us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836438.256739:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787836438.256753:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787836438.256758:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193163392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256799:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193163392:12345-0@lo:400:kworker.0 Request processed in 41us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836438.256805:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787836438.256816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787836438.256822:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193163520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256852:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193163520:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836438.256857:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787836438.256878:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193163904 00000100:00100000:0.0:1787836438.256881:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193163904 00000100:00100000:0.0:1787836438.256907:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193163648 00000100:00100000:0.0:1787836438.256910:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193163648 00000100:00100000:0.0:1787836438.256930:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787836438.256936:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193163904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.256970:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193163904:12345-0@lo:400:kworker.0 Request processed in 35us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836438.256976:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787836438.256986:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787836438.256991:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193163648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.257026:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193163648:12345-0@lo:400:kworker.0 Request processed in 35us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836438.257032:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787836438.257083:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf3c00 x1874682193163648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836438.257096:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193163648:0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.257107:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193163520:0@lo:400:kworker.0 00000100:00100000:0.0:1787836438.257151:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193163392:0@lo:400:kworker.0 00010000:00080000:0.0:1787836438.257160:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf1e00 x1874682193163904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836438.257169:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193163904:0@lo:400:kworker.0 00000100:00080000:3.0:1787836438.257867:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787836438.257873:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787836438.257876:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836438.257911:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193163776:0@lo:400:kworker.0 00010000:00010000:1.0:1787836438.709711:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836438.771366:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193164032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836438.771456:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836438.774532:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193164032 00000100:00100000:2.0:1787836438.774546:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193164032 00000100:00100000:2.0:1787836438.774643:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787836438.774655:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193164032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836438.774699:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836438.774938:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193164032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 286us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836438.774946:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787836438.775025:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d144bc00 x1874682193164032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836438.775047:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193164032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836439.731976:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836440.306803:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787836440.306828:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193164160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836440.306893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836440.306953:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193164160 00000100:00100000:3.0:1787836440.306961:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193164160 00000100:00100000:3.0:1787836440.307007:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787836440.307017:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193164160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787836440.307046:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836440.307104:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193164160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836440.307110:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787836440.307138:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787836440.307162:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5f9a580 x1874682193164160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836440.307178:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193164160:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787836440.351715:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a64a6682-9f1f-4978-b16c-a7d486c0bf01 00000001:00100000:1.0:1787836440.360470:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a64a6682-9f1f-4978-b16c-a7d486c0bf01 00010000:00010000:0.0:1787836440.752608:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836441.205886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836441.209302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836441.209614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836441.209695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836441.209726:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172158464 00000100:00100000:1.0:1787836441.209735:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172158464 00000100:00100000:1.0:1787836441.209807:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:1.0:1787836441.209818:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee50d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172158464:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836441.209886:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee50d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172158464:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836441.209905:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:1.0:1787836441.210118:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172158208 00000100:00100000:1.0:1787836441.210123:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172158208 00000100:00100000:1.0:1787836441.210148:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172158336 00000100:00100000:1.0:1787836441.210151:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172158336 00000100:00100000:1.0:1787836441.210173:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:1.0:1787836441.210180:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172158208:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836441.210211:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172158208:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 31us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836441.210218:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:1.0:1787836441.210230:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:1.0:1787836441.210236:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172158336:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836441.210258:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172158336:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836441.210264:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00080000:1.0:1787836441.210278:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787836441.210282:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836441.212165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172158080 00000100:00100000:0.0:1787836441.212177:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172158080 00000100:00100000:0.0:1787836441.212229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 225 00000100:00100000:0.0:1787836441.212238:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2363:x1874682172158080:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836441.212312:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2363:x1874682172158080:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 76us (6438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836441.212320:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 225 00000100:00100000:3.0:1787836441.225965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836441.226698:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172158592 00000100:00100000:0.0:1787836441.226707:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172158592 00000100:00100000:0.0:1787836441.226786:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:0.0:1787836441.226797:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172158592:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836441.226873:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172158592:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 78us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836441.226881:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00080000:3.0:1787836441.236463:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787836441.774208:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787836442.163803:0:10322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787836442.799517:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836443.374987:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193164544:0@lo:400:kworker.0 00000100:00100000:2.0:1787836443.375096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836443.375161:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836443.375167:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d14492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193164672:0@lo:400:kworker.0 00000100:00100000:2.0:1787836443.375194:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836443.375229:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193164544 00000100:00100000:2.0:1787836443.375236:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193164544 00000100:00100000:0.0:1787836443.375518:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1449680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193164288:0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.375556:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836443.375601:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d14483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193164800:0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.375626:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836443.375645:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787836443.375650:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193164416:0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.375671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836443.375688:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193164928:0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.375707:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836443.375749:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193164288 00000100:00100000:0.0:1787836443.375753:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193164288 00000100:00100000:0.0:1787836443.375796:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787836443.375805:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.375862:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193164288:12345-0@lo:400:kworker.0 Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836443.375868:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787836443.375904:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193164800 00000100:00100000:0.0:1787836443.375908:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193164800 00000100:00100000:2.0:1787836443.375940:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787836443.375951:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193164544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836443.375987:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193164544:12345-0@lo:400:kworker.0 Request processed in 40us (900us total) trans 0 rc 0/0 00000100:00080000:3.0:1787836443.376482:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836443.376500:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193164672 00000100:00100000:3.0:1787836443.376506:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193164672 00000100:00100000:3.0:1787836443.376559:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193164928 00000100:00100000:3.0:1787836443.376562:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193164928 00000100:00100000:3.0:1787836443.376993:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787836443.377003:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193164672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836443.377193:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193164672:12345-0@lo:400:kworker.0 Request processed in 192us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836443.377200:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787836443.377215:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787836443.377222:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193164928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836443.377248:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193164928:12345-0@lo:400:kworker.0 Request processed in 27us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836443.377253:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787836443.377364:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787836443.377369:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836443.377390:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193164416 00000100:00100000:3.0:1787836443.377394:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193164416 00000100:00100000:0.0:1787836443.377818:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787836443.377829:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193164800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.377872:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193164800:12345-0@lo:400:kworker.0 Request processed in 46us (2244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836443.377877:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1787836443.377942:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d144bc00 x1874682193164928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836443.377955:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193164928:0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.377965:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1449680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193164288:0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.377975:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d14483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193164800:0@lo:400:kworker.0 00010000:00080000:0.0:1787836443.382314:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d14492c0 x1874682193164672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836443.382338:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d14492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193164672:0@lo:400:kworker.0 00000100:00100000:0.0:1787836443.382354:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193164544:0@lo:400:kworker.0 00000100:00100000:2.0:1787836443.385691:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787836443.390664:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787836443.390692:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193164416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836443.390816:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193164416:12345-0@lo:400:kworker.0 Request processed in 134us (15142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836443.390824:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787836443.391407:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193164416:0@lo:400:kworker.0 00010000:00010000:0.0:1787836443.823390:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836443.888691:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193165056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836443.888787:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836443.888856:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193165056 00000100:00100000:0.0:1787836443.888863:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193165056 00000100:00100000:0.0:1787836443.888903:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787836443.888911:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193165056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836443.888953:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836443.888997:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193165056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836443.889004:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787836443.889080:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d02580 x1874682193165056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836443.889099:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193165056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787836444.846612:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836445.422878:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836445.422912:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193165184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836445.423028:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836445.423158:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193165184 00000100:00100000:0.0:1787836445.423168:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193165184 00000100:00100000:0.0:1787836445.423252:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787836445.423404:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193165184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836445.423450:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836445.424129:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193165184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 725us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836445.424140:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787836445.424176:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787836445.431434:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d03840 x1874682193165184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836445.431474:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193165184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787836445.871241:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836446.322588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836446.322681:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172158720 00000100:00100000:3.0:1787836446.322697:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172158720 00000100:00100000:3.0:1787836446.322796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 227 00000100:00100000:3.0:1787836446.322810:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172158720:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836446.322927:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172158720:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 120us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836446.322937:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 227 00000100:00100000:0.0:1787836446.327356:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836446.328481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836446.328515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836446.328563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836446.328665:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172158976 00000100:00100000:3.0:1787836446.328682:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172158976 00000100:00100000:3.0:1787836446.328856:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172158848 00000100:00100000:3.0:1787836446.328861:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172158848 00000100:00100000:3.0:1787836446.328910:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:3.0:1787836446.328923:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172158976:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836446.329034:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172158976:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 115us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836446.329044:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:3.0:1787836446.329088:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:3.0:1787836446.329097:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172158848:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836446.329125:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172158848:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 30us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836446.329133:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:3.0:1787836446.329162:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172159232 00000100:00100000:3.0:1787836446.329165:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172159232 00000100:00100000:3.0:1787836446.329201:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172159104 00000100:00100000:3.0:1787836446.329205:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172159104 00000100:00100000:3.0:1787836446.329236:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:3.0:1787836446.329246:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159232:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836446.334291:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:2.0:1787836446.334326:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159104:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836446.334436:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159104:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 121us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836446.334445:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00080000:2.0:1787836446.334869:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787836446.334884:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787836446.334888:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836446.341569:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159232:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 12294us (13063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836446.341588:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00010000:00010000:0.0:1787836446.894863:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836447.919029:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836448.495470:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193165440:0@lo:400:kworker.0 00000100:00100000:0.0:1787836448.495571:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836448.495643:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193165952:0@lo:400:kworker.0 00000100:00100000:0.0:1787836448.495671:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836448.495730:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787836448.495737:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193165312:0@lo:400:kworker.0 00000100:00100000:0.0:1787836448.495769:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836448.495792:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193165824:0@lo:400:kworker.0 00000100:00100000:1.0:1787836448.495803:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193165952 00000100:00100000:1.0:1787836448.495812:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193165952 00000100:00100000:0.0:1787836448.495814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836448.495840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193165312 00000100:00100000:0.0:1787836448.495843:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193165312 00000100:00100000:1.0:1787836448.495887:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787836448.495887:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787836448.495897:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193165952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836448.495897:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193165312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836448.495950:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193165312:12345-0@lo:400:kworker.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836448.495957:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787836448.496203:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193165568:0@lo:400:kworker.0 00000100:00100000:2.0:1787836448.496244:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836448.496267:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836448.496272:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193165696:0@lo:400:kworker.0 00000100:00100000:2.0:1787836448.496293:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836448.496324:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193165440 00000100:00100000:2.0:1787836448.496328:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193165440 00000100:00100000:2.0:1787836448.496356:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193165824 00000100:00100000:2.0:1787836448.496359:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193165824 00000100:00100000:2.0:1787836448.496372:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193165568 00000100:00100000:2.0:1787836448.496375:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193165568 00000100:00100000:2.0:1787836448.496390:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787836448.496396:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193165440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836448.496542:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193165952:12345-0@lo:400:kworker.0 Request processed in 645us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836448.496551:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787836448.496568:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193165696 00000100:00100000:1.0:1787836448.496571:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193165696 00000100:00100000:1.0:1787836448.496597:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787836448.496603:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193165696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836448.496822:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193165696:12345-0@lo:400:kworker.0 Request processed in 218us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836448.496831:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787836448.499482:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787836448.499529:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193165824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836448.499678:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193165824:12345-0@lo:400:kworker.0 Request processed in 180us (3861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836448.499687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787836448.499744:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787836448.499777:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193165568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836448.499816:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193165568:12345-0@lo:400:kworker.0 Request processed in 42us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836448.499822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787836448.500556:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193165312:0@lo:400:kworker.0 00000100:00100000:0.0:1787836448.500626:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193165824:0@lo:400:kworker.0 00000100:00100000:2.0:1787836448.506602:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193165440:12345-0@lo:400:kworker.0 Request processed in 10189us (11014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836448.506638:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787836448.507284:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787836448.507295:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787836448.507299:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787836448.507376:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d003c0 x1874682193165696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836448.507397:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193165696:0@lo:400:kworker.0 00000100:00100000:2.0:1787836448.507417:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193165568:0@lo:400:kworker.0 00000100:00100000:0.0:1787836448.511397:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193165440:0@lo:400:kworker.0 00010000:00080000:0.0:1787836448.515105:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d03840 x1874682193165952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836448.515134:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193165952:0@lo:400:kworker.0 00010000:00010000:3.0:1787836448.942277:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836449.009009:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787836449.009045:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193166080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787836449.009175:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836449.009424:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193166080 00000100:00100000:0.0:1787836449.009434:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193166080 00000100:00100000:0.0:1787836449.009503:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787836449.009525:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193166080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836449.009572:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836449.009635:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193166080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836449.009645:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787836449.009742:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d03840 x1874682193166080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836449.009764:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193166080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787836449.966648:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836450.552126:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836450.552160:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193166208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836450.552259:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836450.552537:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193166208 00000100:00100000:0.0:1787836450.552547:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193166208 00000100:00100000:0.0:1787836450.552628:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787836450.552639:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193166208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836450.552699:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836450.552774:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193166208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836450.552782:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787836450.552967:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d00b40 x1874682193166208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836450.552988:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193166208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787836450.557075:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787836451.013545:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836451.441762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836451.441810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836451.441845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836451.441863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836451.441886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836451.441915:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172159744 00000100:00100000:3.0:1787836451.441925:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172159744 00000100:00100000:3.0:1787836451.441991:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172159872 00000100:00100000:3.0:1787836451.441995:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172159872 00000100:00100000:3.0:1787836451.442021:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:3.0:1787836451.442031:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159744:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836451.442144:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159744:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 114us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836451.442152:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:3.0:1787836451.442169:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:3.0:1787836451.442186:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159872:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836451.442396:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159872:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836451.442406:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:3.0:1787836451.442430:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172159360 00000100:00100000:3.0:1787836451.442434:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172159360 00000100:00100000:3.0:1787836451.442463:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 229 00000100:00100000:3.0:1787836451.442469:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172159360:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836451.442496:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172159360:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836451.442502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 229 00000100:00100000:3.0:1787836451.442530:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172159488 00000100:00100000:3.0:1787836451.442533:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172159488 00000100:00100000:3.0:1787836451.442560:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172159616 00000100:00100000:3.0:1787836451.442563:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172159616 00000100:00100000:3.0:1787836451.442584:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:3.0:1787836451.442591:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172159488:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836451.442618:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172159488:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836451.442623:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:3.0:1787836451.442633:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:3.0:1787836451.442639:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159616:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836451.442660:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172159616:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 21us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836451.442666:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00080000:3.0:1787836451.442703:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836451.442708:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787836451.442711:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787836452.014995:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836453.038838:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836453.614496:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193166720:0@lo:400:kworker.0 00000100:00100000:3.0:1787836453.614571:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193166592:0@lo:400:kworker.0 00000100:00100000:2.0:1787836453.614588:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836453.614620:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836453.614693:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193166336:0@lo:400:kworker.0 00000100:00100000:0.0:1787836453.614731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836453.614778:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193166336 00000100:00100000:0.0:1787836453.614786:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193166336 00000100:00100000:3.0:1787836453.614799:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193166720 00000100:00100000:3.0:1787836453.614805:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193166720 00000100:00100000:0.0:1787836453.614846:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787836453.614865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193166336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836453.614879:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787836453.614891:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193166720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836453.614925:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193166336:12345-0@lo:400:kworker.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836453.614933:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787836453.614942:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193166720:12345-0@lo:400:kworker.0 Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836453.614950:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787836453.614972:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193166592 00000100:00080000:3.0:1787836453.614975:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836453.614977:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193166592 00000100:00080000:3.0:1787836453.615018:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836453.615020:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787836453.615029:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193166592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836453.615101:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193166592:12345-0@lo:400:kworker.0 Request processed in 73us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836453.615107:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1787836453.615356:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fb9680 x1874682193166720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836453.615370:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193166720:0@lo:400:kworker.0 00000100:00100000:1.0:1787836453.615453:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193166464:0@lo:400:kworker.0 00000100:00100000:1.0:1787836453.615483:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836453.615527:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193166464 00000100:00100000:3.0:1787836453.615533:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193166464 00000100:00100000:0.0:1787836453.615583:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193166336:0@lo:400:kworker.0 00000100:00100000:0.0:1787836453.615592:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193166848:0@lo:400:kworker.0 00000100:00100000:3.0:1787836453.615620:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787836453.615630:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193166464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836453.615691:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193166592:0@lo:400:kworker.0 00000100:00100000:1.0:1787836453.615713:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193166976:0@lo:400:kworker.0 00000100:00100000:3.0:1787836453.615732:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193166464:12345-0@lo:400:kworker.0 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836453.615740:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787836453.615747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836453.615772:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193166976 00000100:00100000:3.0:1787836453.615778:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193166976 00000100:00100000:1.0:1787836453.615792:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193166464:0@lo:400:kworker.0 00000100:00100000:3.0:1787836453.615881:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787836453.615888:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193166976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836453.615922:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193166976:12345-0@lo:400:kworker.0 Request processed in 34us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836453.615927:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787836453.616092:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fb92c0 x1874682193166976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836453.616103:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193166976:0@lo:400:kworker.0 00000100:00080000:2.0:1787836453.616307:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787836453.622654:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836453.626235:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193166848 00000100:00100000:3.0:1787836453.626249:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193166848 00000100:00080000:2.0:1787836453.626422:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836453.626483:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787836453.626495:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193166848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836453.626628:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193166848:12345-0@lo:400:kworker.0 Request processed in 136us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836453.626635:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787836453.626739:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193166848:0@lo:400:kworker.0 00010000:00010000:0.0:1787836454.065438:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836454.127976:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193167104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836454.128049:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836454.128150:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193167104 00000100:00100000:1.0:1787836454.128157:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193167104 00000100:00100000:1.0:1787836454.128200:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787836454.128209:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193167104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787836454.128244:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836454.131747:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193167104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836454.131761:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787836454.131843:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d00b40 x1874682193167104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836454.131868:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193167104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787836455.088248:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836455.667104:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787836455.667125:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193167232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836455.667192:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836455.667264:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193167232 00000100:00100000:3.0:1787836455.667271:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193167232 00000100:00100000:3.0:1787836455.667321:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787836455.667329:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193167232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787836455.667362:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836455.667407:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193167232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836455.667414:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787836455.667455:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5f99a40 x1874682193167232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836455.667472:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193167232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787836455.668535:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787836456.113166:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836456.556491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836456.556538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836456.556564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836456.556594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836456.556655:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172160128 00000100:00100000:2.0:1787836456.556666:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172160128 00000100:00100000:0.0:1787836456.556682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836456.556710:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172160256 00000100:00100000:0.0:1787836456.556714:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172160256 00000100:00100000:2.0:1787836456.556738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:2.0:1787836456.556750:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172160128:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836456.556824:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172160128:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836456.559724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:3.0:1787836456.559840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172160000 00000100:00100000:3.0:1787836456.559849:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172160000 00000100:00100000:3.0:1787836456.559894:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 231 00000100:00100000:3.0:1787836456.559905:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172160000:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836456.559968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:3.0:1787836456.559977:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172160000:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 73us (3437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836456.559984:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172160256:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836456.560000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 231 00000100:00100000:0.0:1787836456.560026:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172160256:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 48us (3460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836456.560044:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00080000:2.0:1787836456.560047:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836456.560091:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172160384 00000100:00100000:0.0:1787836456.560097:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172160384 00000100:00100000:0.0:1787836456.560138:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172160512 00000100:00100000:0.0:1787836456.560142:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172160512 00000100:00100000:0.0:1787836456.560171:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:0.0:1787836456.560179:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2360:x1874682172160384:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:0.0:1787836456.560199:0:10087:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab754a 00000100:00080000:0.0:1787836456.560209:0:10087:0:(import.c:65:import_set_state_nolock()) ffff98e401e6e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787836456.560247:0:10087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1787836456.560356:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787836456.560361:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836456.560429:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:2.0:1787836456.560439:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2360:x1874682172160512:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:2.0:1787836456.560464:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7551 00000100:00080000:2.0:1787836456.560470:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98e3d01ca000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787836456.560506:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787836456.560521:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836456.560550:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836456.560807:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+2:2360:x1874682172160512:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 369us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836456.560815:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1787836456.561210:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+2:2360:x1874682172160384:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 1030us (4613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836456.561218:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00010000:00010000:0.0:1787836457.135724:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787836457.782353:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a64a6682-9f1f-4978-b16c-a7d486c0bf01 00000020:00000080:0.0:1787836457.782364:0:6718:0:(genops.c:885:class_export_put()) final put ffff98e401e6d800/a64a6682-9f1f-4978-b16c-a7d486c0bf01 00000020:00000080:3.0:1787836457.783128:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e401e6d800/a64a6682-9f1f-4978-b16c-a7d486c0bf01 for lustre-OST0000 00000020:00000080:3.0:1787836457.783599:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e401e6e800 for lustre-OST0000 00010000:00010000:0.0:1787836458.158650:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836458.740017:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787836458.740104:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193167616:0@lo:400:kworker.0 00000100:00100000:3.0:1787836458.740227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836458.740339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193167616 00000100:00100000:3.0:1787836458.740348:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193167616 00000100:00100000:3.0:1787836458.740433:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787836458.740448:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193167616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836458.740547:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193167616:12345-0@lo:400:kworker.0 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836458.740554:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1787836458.740576:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836458.740979:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193167488:0@lo:400:kworker.0 00000100:00100000:2.0:1787836458.741041:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836458.741123:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787836458.741135:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193167360:0@lo:400:kworker.0 00000100:00100000:2.0:1787836458.741188:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836458.746159:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193167360 00000100:00100000:1.0:1787836458.746180:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193167360 00000100:00100000:1.0:1787836458.746267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787836458.746276:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193167360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836458.746387:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193167488 00000100:00100000:2.0:1787836458.746392:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193167488 00000100:00100000:2.0:1787836458.746426:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787836458.746434:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193167488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836458.746834:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193167360:12345-0@lo:400:kworker.0 Request processed in 558us (5646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836458.746858:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787836458.747044:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193167616:0@lo:400:kworker.0 00000100:00100000:3.0:1787836458.747702:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193167360:0@lo:400:kworker.0 00000100:00100000:1.0:1787836458.747775:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193167744:0@lo:400:kworker.0 00000100:00100000:1.0:1787836458.747817:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836458.747902:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193167744 00000100:00100000:3.0:1787836458.747908:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193167744 00000100:00100000:3.0:1787836458.747970:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787836458.747978:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193167744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836458.748017:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193167744:12345-0@lo:400:kworker.0 Request processed in 41us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836458.748024:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787836458.748169:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787836458.748197:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3ddfc00 x1874682193167744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836458.748209:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193167744:0@lo:400:kworker.0 00000100:00100000:0.0:1787836458.748363:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193167872:0@lo:400:kworker.0 00000100:00100000:0.0:1787836458.748400:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836458.748428:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836458.748436:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193168000:0@lo:400:kworker.0 00000100:00100000:0.0:1787836458.748460:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836458.748494:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193167488:0@lo:400:kworker.0 00000100:00100000:0.0:1787836458.748542:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193167872 00000100:00100000:0.0:1787836458.748546:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193167872 00000100:00100000:0.0:1787836458.748578:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787836458.748726:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d14492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193167872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836458.748768:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d14492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193167872:12345-0@lo:400:kworker.0 Request processed in 45us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836458.748812:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193168000 00000100:00100000:1.0:1787836458.748816:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193168000 00000100:00100000:1.0:1787836458.748847:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787836458.748854:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193168000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836458.748887:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193168000:12345-0@lo:400:kworker.0 Request processed in 35us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836458.748894:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787836458.748916:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836458.748931:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836458.749040:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193167488:12345-0@lo:400:kworker.0 Request processed in 850us (6244us total) trans 0 rc 0/0 00010000:00080000:1.0:1787836458.752440:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d1448780 x1874682193168000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836458.752473:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193168000:0@lo:400:kworker.0 00000100:00100000:1.0:1787836458.752503:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193167872:0@lo:400:kworker.0 00000100:00100000:0.0:1787836458.753396:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787836458.754561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:3.0:1787836459.189690:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836459.247304:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836459.247337:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193168128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836459.247436:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836459.247568:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193168128 00000100:00100000:2.0:1787836459.247579:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193168128 00000100:00100000:2.0:1787836459.247660:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787836459.247673:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193168128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836459.247721:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836459.247770:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193168128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836459.247779:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787836459.247860:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fba1c0 x1874682193168128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836459.247883:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193168128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787836460.206859:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836460.785497:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1449680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193168256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836460.785604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836460.788628:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193168256 00000100:00100000:0.0:1787836460.788651:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193168256 00000100:00100000:0.0:1787836460.788764:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787836460.788778:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193168256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836460.790376:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836460.790489:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193168256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1710us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836460.790502:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787836460.790570:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787836460.790631:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d1449680 x1874682193168256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836460.790660:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1449680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193168256:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787836460.875543:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a64a6682-9f1f-4978-b16c-a7d486c0bf01 00000020:00000080:3.0:1787836460.875560:0:7644:0:(genops.c:885:class_export_put()) final put ffff98e3d01cb800/a64a6682-9f1f-4978-b16c-a7d486c0bf01 00000020:00000080:1.0:1787836460.875630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d01cb800/a64a6682-9f1f-4978-b16c-a7d486c0bf01 for lustre-OST0001 00000020:00000080:1.0:1787836460.875681:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3d01ca000 for lustre-OST0001 00010000:00010000:0.0:1787836461.230532:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836461.680402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836461.680450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836461.680490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836461.680628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172160896 00000100:00100000:1.0:1787836461.680649:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172160896 00000100:00100000:3.0:1787836461.680725:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172160640 00000100:00100000:1.0:1787836461.680731:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172160768 00000100:00100000:3.0:1787836461.680732:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172160640 00000100:00100000:1.0:1787836461.680738:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172160768 00000100:00100000:1.0:1787836461.680767:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:1.0:1787836461.680789:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1449680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172160896:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836461.680856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 233 00000100:00100000:3.0:1787836461.680867:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172160640:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836461.680969:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1449680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172160896:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 191us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836461.680977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:1.0:1787836461.681003:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:1.0:1787836461.681010:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172160768:12345-192.168.203.25@tcp:400:kworker.0 00000100:00080000:0.0:1787836461.681352:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836461.685925:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172160640:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 5046us (5525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836461.685941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 233 00000100:00100000:1.0:1787836461.689370:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172160768:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 8341us (8860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836461.689388:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 93 00010000:00010000:3.0:1787836462.256988:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787836462.589456:0:11023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787836463.278465:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836463.861044:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836463.861093:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193168384:0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.861297:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836463.861428:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193168512:0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.861465:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836463.861547:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193168512 00000100:00100000:1.0:1787836463.861556:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193168512 00000100:00100000:1.0:1787836463.861622:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787836463.861632:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193168512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.861695:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193168512:12345-0@lo:400:kworker.0 Request processed in 64us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836463.861702:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787836463.861757:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193168512:0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.861806:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193168640:0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.861832:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836463.861863:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193168640 00000100:00100000:1.0:1787836463.861867:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193168640 00000100:00100000:1.0:1787836463.861901:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787836463.861907:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193168640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.861948:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193168640:12345-0@lo:400:kworker.0 Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836463.861954:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1787836463.861972:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836463.861998:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193168768:0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.862024:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836463.862054:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193168768 00000100:00100000:1.0:1787836463.862081:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193168768 00000100:00100000:1.0:1787836463.862117:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787836463.862125:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193168768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836463.862128:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193168384 00000100:00100000:2.0:1787836463.862134:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193168384 00000100:00100000:1.0:1787836463.862171:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193168768:12345-0@lo:400:kworker.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836463.862176:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787836463.862192:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787836463.862213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787836463.862247:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d3b83480 x1874682193168768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836463.862258:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193168768:0@lo:400:kworker.0 00000100:00100000:2.0:1787836463.862266:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193168384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.862293:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193168896:0@lo:400:kworker.0 00000100:00100000:2.0:1787836463.862327:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193168384:12345-0@lo:400:kworker.0 Request processed in 143us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836463.862336:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836463.862340:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787836463.862369:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193168896 00000100:00100000:1.0:1787836463.862373:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193168896 00000100:00080000:2.0:1787836463.862403:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836463.862411:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787836463.862418:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193168896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.862464:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193168896:12345-0@lo:400:kworker.0 Request processed in 47us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836463.862470:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787836463.862496:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193168384:0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.862530:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193169024:0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.862554:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836463.862577:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193169024 00000100:00100000:1.0:1787836463.862580:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193169024 00000100:00100000:3.0:1787836463.862613:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193168640:0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.862620:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787836463.862625:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193169024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836463.862664:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193169024:12345-0@lo:400:kworker.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836463.862670:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787836463.862696:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836463.862966:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193168896:0@lo:400:kworker.0 00010000:00080000:3.0:1787836463.863154:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c198ed00 x1874682193169024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836463.863165:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193169024:0@lo:400:kworker.0 00010000:00010000:0.0:1787836464.306350:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836464.368300:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836464.368323:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193169152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836464.368410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836464.368651:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193169152 00000100:00100000:2.0:1787836464.368660:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193169152 00000100:00100000:2.0:1787836464.368714:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787836464.368724:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193169152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836464.368759:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836464.368798:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193169152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836464.368805:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787836464.368908:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fb92c0 x1874682193169152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836464.368929:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193169152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787836465.326333:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836465.908311:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193169280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836465.908383:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836465.908458:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193169280 00000100:00100000:1.0:1787836465.908465:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193169280 00000100:00100000:1.0:1787836465.908515:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787836465.908523:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193169280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787836465.908559:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836465.908611:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193169280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836465.908618:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787836465.908640:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787836465.908665:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c198ed00 x1874682193169280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836465.908682:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193169280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787836466.358690:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787836466.418542:0:11171:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca5447370 20000000:00000080:1.0:1787836466.418561:0:11171:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e2c13a5400 uarg=0000000000000000 20000000:01000000:1.0:1787836466.418607:0:11171:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787836466.418613:0:11171:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787836466.418618:0:11171:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787836466.420368:0:11172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787836466.420827:0:11171:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787836466.431300:0:11171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787836466.431662:0:11171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.431911:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab74fd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.431921:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab750b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.432001:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab7519 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.432012:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.432037:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.432044:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.433637:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.433658:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 12 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836466.433675:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169408:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836466.433833:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.433842:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 12 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836466.433850:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169536:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836466.433883:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab7519 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.433892:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab7519 expref: 18 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836466.433900:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169664:0@lo:104: 00000100:00100000:3.0:1787836466.433949:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836466.433990:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab750b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.433998:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab750b expref: 18 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836466.434006:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169792:0@lo:104: 00000100:00100000:3.0:1787836466.434026:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836466.434083:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab74fd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.434091:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab74fd expref: 18 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836466.434100:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d00b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169920:0@lo:104: 00000100:00100000:3.0:1787836466.434132:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836466.434193:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193169664 00000100:00100000:0.0:1787836466.434200:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193169664 00000100:00100000:0.0:1787836466.434241:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193169792 00000100:00100000:0.0:1787836466.434244:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193169792 00000100:00100000:0.0:1787836466.434252:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193169920 00000100:00100000:0.0:1787836466.434254:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193169920 00000100:00100000:0.0:1787836466.434267:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787836466.434275:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:11171:x1874682193169664:12345-0@lo:104: 00010000:00010000:0.0:1787836466.434287:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434336:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836466.434341:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:11171:x1874682193169664:12345-0@lo:104: Request processed in 68us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836466.434347:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787836466.434363:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787836466.434369:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:11171:x1874682193169792:12345-0@lo:104: 00010000:00010000:0.0:1787836466.434377:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434437:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787836466.434442:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:11171:x1874682193169792:12345-0@lo:104: Request processed in 74us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836466.434448:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787836466.434461:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787836466.434468:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:11171:x1874682193169920:12345-0@lo:104: 00010000:00010000:0.0:1787836466.434475:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434505:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787836466.434516:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:11171:x1874682193169920:12345-0@lo:104: Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836466.434522:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787836466.434550:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787836466.434556:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434563:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad800 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836466.434567:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434588:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836466.434596:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836466.434602:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787836466.434628:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434634:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836466.434655:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434661:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e2c13ad800/0x966835ea68ab7519 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7520 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434674:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787836466.434677:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434693:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5000 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836466.434696:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434703:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836466.434709:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836466.434714:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787836466.434727:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434733:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836466.434739:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434745:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5000/0x966835ea68ab750b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434753:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836466.434756:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434761:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ace00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836466.434763:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434779:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836466.434785:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836466.434791:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787836466.434806:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434812:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836466.434828:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434834:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab74fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7504 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.434847:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836466.434849:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836466.434851:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836466.434857:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836466.434862:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836466.434873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193170176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787836466.434905:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836466.435686:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193170048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836466.435731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836466.435840:0:11171:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce37c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787836466.435870:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169664:0@lo:104: 00000100:00100000:3.0:1787836466.435882:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169792:0@lo:104: 00000100:00100000:3.0:1787836466.435890:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d00b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169920:0@lo:104: 00000100:00100000:0.0:1787836466.436048:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193170304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787836466.436126:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836466.436173:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193170176 00000100:00100000:0.0:1787836466.436179:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193170176 00010000:00010000:0.0:1787836466.436227:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab750b expref: 19 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836466.436254:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193170048 00000100:00100000:0.0:1787836466.436257:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193170048 00010000:00010000:0.0:1787836466.436269:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7519 expref: 20 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836466.436284:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193170304 00000100:00100000:0.0:1787836466.436287:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193170304 00010000:00010000:0.0:1787836466.436297:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab74fd expref: 21 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836466.436310:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787836466.436319:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8603050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+21:3313:x1874682193170176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787836466.436331:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836466.436335:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab750b expref: 21 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.436344:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab750b expref: 21 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.436359:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005be00/0x966835ea68ab7512 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab750b expref: 21 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.436375:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836466.436800:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8603050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+20:3313:x1874682193170176:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836466.436809:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787836466.436864:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787836466.436871:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193170048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787836466.436889:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836466.436895:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab7519 expref: 19 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.436905:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab7519 expref: 19 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.436917:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005a800/0x966835ea68ab7520 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab7519 expref: 19 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.436999:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836466.437036:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:3312:x1874682193170048:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836466.437043:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787836466.437162:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787836466.437172:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:3310:x1874682193170304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787836466.437180:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836466.437185:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab74fd expref: 18 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.437193:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab74fd expref: 18 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.437216:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f5600/0x966835ea68ab7504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab74fd expref: 18 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.437226:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836466.437258:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:3310:x1874682193170304:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836466.437264:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787836466.437343:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193170304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787836466.437379:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193170176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836466.441502:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193170048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787836466.442052:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169536:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836466.448148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836466.448241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836466.449579:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172161024 00000100:00100000:0.0:1787836466.449592:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172161024 00010000:00010000:0.0:1787836466.449654:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 13 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836466.449689:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172161152 00000100:00100000:0.0:1787836466.449693:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172161152 00010000:00010000:0.0:1787836466.449704:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 14 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836466.449728:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:0.0:1787836466.449738:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+14:2364:x1874682172161024:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836466.449772:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836466.449778:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 14 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.449787:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 14 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.449805:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005a200/0x966835ea68ab7527 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddca expref: 14 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.449822:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836466.449877:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172161024:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 140us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836466.449886:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:0.0:1787836466.449901:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:0.0:1787836466.449908:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:2363:x1874682172161152:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836466.449916:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836466.449921:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 12 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.449941:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 12 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.449954:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.449963:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.449988:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.449995:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.450001:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.450022:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.450029:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836466.450033:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.450041:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.450051:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836466.450089:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836466.450121:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:2363:x1874682172161152:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 201us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836466.450127:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00010000:00010000:3.0:1787836466.453367:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031600/0x966835ea68ab753c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede02 expref: 11 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836466.453390:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874682193169408:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836466.453671:0:11171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.453683:0:11171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.453689:0:11171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836466.453694:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7558 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836466.794522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836466.794576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836466.794651:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172161280 00000100:00100000:2.0:1787836466.794663:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172161280 00000100:00100000:2.0:1787836466.794739:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172161408 00000100:00100000:2.0:1787836466.794742:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172161408 00000100:00100000:2.0:1787836466.794766:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:2.0:1787836466.794776:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172161280:12345-192.168.203.25@tcp:400:kworker.0 00000100:00080000:1.0:1787836466.794949:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836466.795233:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172161280:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 98us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836466.795242:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:2.0:1787836466.795262:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00100000:2.0:1787836466.795269:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d2180b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172161408:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836466.795297:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d2180b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172161408:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 29us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836466.795303:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 98 00010000:00010000:1.0:1787836467.374412:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787836467.888304:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787836467.888314:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e2c1c4b800 from 7 10000000:01000000:2.0:1787836467.888320:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787836467.888373:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.888387:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.888400:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836467.888430:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787836467.888506:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836467.888554:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193170432 00000100:00100000:2.0:1787836467.888592:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787836467.888936:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193170432 00000100:00100000:3.0:1787836467.889000:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787836467.889010:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193170432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836467.889035:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836467.889050:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab755f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.889105:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab755f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.889119:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab755f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.889129:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac000, rc 0) 00000100:00100000:3.0:1787836467.889170:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193170432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836467.889178:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787836467.889542:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836467.890111:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.890141:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836467.890696:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836467.890762:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836467.890894:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce37cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836467.893206:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193170560 00000100:00100000:2.0:1787836467.893227:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193170560 00000100:00100000:3.0:1787836467.893416:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787836467.893428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193170560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836467.894978:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193170560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1542us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836467.894992:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787836467.895187:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836467.895259:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836467.895310:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836467.895397:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787836467.895442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193170688 00000100:00100000:1.0:1787836467.895451:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193170688 00000100:00100000:1.0:1787836467.895539:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787836467.895548:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193170688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787836467.895787:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193170688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836467.895795:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787836467.895879:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787836467.896884:0:11194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787836467.896955:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787836467.896976:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787836467.896987:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.896999:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836467.897011:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787836467.897014:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3d01b2000 from 7 10000000:01000000:2.0:1787836467.897017:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787836467.897081:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.897089:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.897117:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836467.897138:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787836467.897196:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836467.898696:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836467.899283:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193170816 00000100:00100000:3.0:1787836467.899296:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193170816 00000100:00100000:3.0:1787836467.899371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787836467.899383:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193170816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836467.899405:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836467.899431:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab756d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.899460:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab756d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.899471:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab756d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.899481:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac800, rc 0) 00000100:00100000:3.0:1787836467.899554:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193170816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836467.899571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787836467.907583:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836467.907620:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836467.907658:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836467.907755:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836467.907856:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836467.907908:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836467.908156:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193170944 00000100:00100000:3.0:1787836467.908162:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193170944 00000100:00100000:3.0:1787836467.908212:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787836467.908222:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193170944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836467.908651:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193170944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 429us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836467.908659:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787836467.908850:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193170944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836467.908888:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193171072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836467.908932:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836467.908960:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836467.911240:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193171072 00000100:00100000:3.0:1787836467.911256:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193171072 00000100:00100000:3.0:1787836467.911330:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787836467.911398:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193171072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836467.912595:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193171072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1250us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836467.912608:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787836467.917332:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193171072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787836467.918840:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787836467.919708:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787836467.919739:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787836467.919754:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.919767:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836467.919779:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787836467.919912:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3ce1d0800 from 7 10000000:01000000:2.0:1787836467.919915:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787836467.919956:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.919965:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.919976:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836467.920001:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193171200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787836467.920726:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836467.925048:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193171200 00000100:00100000:3.0:1787836467.925098:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193171200 00000100:00100000:3.0:1787836467.925173:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787836467.925184:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193171200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836467.925200:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836467.925219:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab757b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.925248:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab757b expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.925259:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab757b expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.925268:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad000, rc 0) 00000100:00100000:3.0:1787836467.925342:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193171200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (4619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836467.925349:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787836467.925402:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787836467.925429:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193171200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836467.925448:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836467.925459:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836467.925534:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193171328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836467.925580:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836467.925606:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193171328 00000100:00100000:3.0:1787836467.925616:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193171328 00000100:00100000:3.0:1787836467.925639:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787836467.925645:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193171328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836467.926268:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193171328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 483us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836467.926277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787836467.926313:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce37c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787836467.926328:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193171328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836467.926361:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193171456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836467.926403:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836467.926429:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce37c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836467.926656:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193171456 00000100:00100000:2.0:1787836467.926670:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193171456 00000100:00100000:2.0:1787836467.926710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787836467.926717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193171456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836467.926886:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193171456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836467.926893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787836467.926964:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193171456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787836467.928121:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787836467.928503:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787836467.928524:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787836467.928534:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836467.928544:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836468.074591:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836468.074672:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172161536 00000100:00100000:3.0:1787836468.074681:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172161536 00000100:00100000:3.0:1787836468.074740:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 244 00000100:00100000:3.0:1787836468.074749:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:5601:x1874682172161536:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836468.074765:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836468.074783:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede2c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836468.074811:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836468.074822:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836468.074831:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac600, rc 0) 00000100:00100000:3.0:1787836468.074888:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172161536:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 139us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836468.074903:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 244 00000100:00100000:3.0:1787836468.082378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836468.082477:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172161664 00000100:00100000:1.0:1787836468.082490:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172161664 00000100:00100000:1.0:1787836468.082547:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 245 00000100:00100000:1.0:1787836468.082567:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172161664:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787836468.082848:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172161664:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 291us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836468.082856:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 245 00000100:00100000:0.0:1787836468.087885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836468.089119:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172161792 00000100:00100000:2.0:1787836468.089133:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172161792 00000100:00100000:2.0:1787836468.089199:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 246 00000100:00100000:2.0:1787836468.089210:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172161792:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836468.089477:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172161792:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 267us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836468.089487:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 246 00000100:00100000:1.0:1787836468.099543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836468.099798:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172161920 00000100:00100000:3.0:1787836468.099808:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172161920 00000100:00100000:3.0:1787836468.099872:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 247 00000100:00100000:3.0:1787836468.099884:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172161920:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836468.099904:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836468.099922:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede33 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836468.099955:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836468.099966:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836468.099975:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad400, rc 0) 00000100:00100000:3.0:1787836468.100036:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172161920:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 154us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836468.100043:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 247 00000100:00100000:0.0:1787836468.110434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836468.110630:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172162048 00000100:00100000:3.0:1787836468.110642:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172162048 00000100:00100000:3.0:1787836468.110710:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 248 00000100:00100000:3.0:1787836468.110721:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172162048:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836468.111026:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172162048:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 307us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836468.111044:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 248 00000100:00100000:0.0:1787836468.116996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836468.117106:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172162176 00000100:00100000:1.0:1787836468.117116:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172162176 00000100:00100000:1.0:1787836468.117167:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 249 00000100:00100000:1.0:1787836468.117177:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172162176:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787836468.117457:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172162176:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 281us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836468.117477:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 249 00010000:00010000:0.0:1787836468.402297:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836468.984674:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193171968:0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.984801:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836468.984853:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787836468.984860:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193171584:0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.984888:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836468.984929:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193172096:0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.984960:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836468.984991:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193171712:0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.985013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836468.985029:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193172224:0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.985049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836468.985088:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787836468.985094:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193171840:0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.985117:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836468.985148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193171584 00000100:00100000:2.0:1787836468.985155:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193171584 00000100:00100000:2.0:1787836468.985200:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787836468.985209:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193171584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.985263:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193171584:12345-0@lo:400:kworker.0 Request processed in 55us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836468.985270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787836468.985302:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193172096 00000100:00100000:2.0:1787836468.985307:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193172096 00000100:00100000:2.0:1787836468.985341:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193171712 00000100:00100000:2.0:1787836468.985344:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193171712 00000100:00100000:2.0:1787836468.985356:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193171840 00000100:00100000:2.0:1787836468.985359:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193171840 00000100:00100000:2.0:1787836468.985376:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787836468.985382:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193172096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.985415:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193172096:12345-0@lo:400:kworker.0 Request processed in 33us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836468.985422:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787836468.985443:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787836468.985449:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193171712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836468.985742:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787836468.985753:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193171840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836468.985799:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193171840:12345-0@lo:400:kworker.0 Request processed in 49us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836468.985806:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787836468.985849:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193171840:0@lo:400:kworker.0 00000100:00100000:3.0:1787836468.985907:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193171584:0@lo:400:kworker.0 00000100:00100000:3.0:1787836468.985918:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193172096:0@lo:400:kworker.0 00000100:00100000:2.0:1787836468.985996:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193171712:12345-0@lo:400:kworker.0 Request processed in 547us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836468.986003:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787836468.986103:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193171712:0@lo:400:kworker.0 00000100:00100000:3.0:1787836468.987169:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193171968 00000100:00100000:3.0:1787836468.987182:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193171968 00000100:00100000:3.0:1787836468.987239:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193172224 00000100:00100000:3.0:1787836468.987243:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193172224 00000100:00100000:3.0:1787836468.987270:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787836468.987278:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193171968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836468.987356:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193171968:12345-0@lo:400:kworker.0 Request processed in 78us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836468.987362:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787836468.987378:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787836468.987384:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193172224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836468.987421:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193172224:12345-0@lo:400:kworker.0 Request processed in 37us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836468.987447:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1787836468.987498:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d1a580 x1874682193172224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836468.987512:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193172224:0@lo:400:kworker.0 00010000:00080000:3.0:1787836468.987542:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d1b480 x1874682193171968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836468.987563:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193171968:0@lo:400:kworker.0 00000100:00080000:1.0:1787836468.987653:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836468.987659:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836468.987662:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787836469.425303:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836469.487330:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193172352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836469.487434:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836469.487572:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193172352 00000100:00100000:3.0:1787836469.487582:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193172352 00000100:00100000:3.0:1787836469.487644:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787836469.487653:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193172352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787836469.487692:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836469.494443:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193172352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6781us (6999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836469.494458:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787836469.498331:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf0780 x1874682193172352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836469.498364:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193172352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836470.446432:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836471.022516:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193172480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836471.022618:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836471.022969:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193172480 00000100:00100000:2.0:1787836471.022978:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193172480 00000100:00100000:2.0:1787836471.023139:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787836471.023152:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193172480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836471.023203:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836471.023263:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193172480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836471.023271:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787836471.023996:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787836471.024045:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fae83c00 x1874682193172480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836471.024093:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193172480:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787836471.065390:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787836471.470332:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836471.914878:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836471.914924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836471.915103:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172162432 00000100:00100000:3.0:1787836471.915128:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172162432 00000100:00100000:3.0:1787836471.915204:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00100000:3.0:1787836471.915215:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172162432:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836471.915288:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172162432:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 75us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836471.915295:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00080000:2.0:1787836471.915408:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836471.915519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836471.915733:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172162560 00000100:00100000:3.0:1787836471.915738:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172162560 00000100:00100000:3.0:1787836471.915793:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 103 00000100:00100000:3.0:1787836471.915801:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172162560:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836471.915840:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172162560:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 40us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836471.915847:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 103 00000100:00080000:2.0:1787836471.915901:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836471.916819:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172162304 00000100:00100000:0.0:1787836471.916828:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172162304 00000100:00100000:0.0:1787836471.916884:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 251 00000100:00100000:0.0:1787836471.916893:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172162304:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836471.917306:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172162304:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 71us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836471.917316:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 251 00010000:00010000:3.0:1787836472.494268:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836473.520771:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836474.094482:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836474.094617:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193172736:0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.094711:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836474.094775:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787836474.094781:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193172864:0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.094803:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836474.094874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193172736 00000100:00100000:2.0:1787836474.094882:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193172736 00000100:00100000:2.0:1787836474.094937:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193172864 00000100:00100000:2.0:1787836474.094940:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193172864 00000100:00100000:2.0:1787836474.094976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787836474.094987:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193172736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.095049:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193172736:12345-0@lo:400:kworker.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836474.095114:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787836474.095132:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787836474.095139:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193172864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.095179:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193172864:12345-0@lo:400:kworker.0 Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836474.095185:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787836474.095205:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836474.095235:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193172864:0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.095247:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193172736:0@lo:400:kworker.0 00000100:00100000:0.0:1787836474.095610:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787836474.095625:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193172992:0@lo:400:kworker.0 00000100:00100000:0.0:1787836474.095663:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836474.098753:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193172992 00000100:00100000:2.0:1787836474.098769:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193172992 00000100:00100000:2.0:1787836474.098899:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787836474.098911:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193172992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.099049:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193172992:12345-0@lo:400:kworker.0 Request processed in 140us (3384us total) trans 0 rc 0/0 00000100:00080000:0.0:1787836474.099213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787836474.099277:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc0b40 x1874682193172992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836474.099292:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193172992:0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.099524:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787836474.102257:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193172608:0@lo:400:kworker.0 00000100:00100000:1.0:1787836474.102355:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836474.102569:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193172608 00000100:00100000:0.0:1787836474.102579:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193172608 00000100:00100000:0.0:1787836474.102888:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787836474.102902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193172608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836474.102986:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193172608:12345-0@lo:400:kworker.0 Request processed in 88us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836474.102992:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787836474.103088:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193172608:0@lo:400:kworker.0 00000100:00100000:1.0:1787836474.105539:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836474.105636:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787836474.105661:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193173248:0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.105759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836474.106121:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193173248 00000100:00100000:3.0:1787836474.106130:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193173248 00000100:00100000:3.0:1787836474.106247:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787836474.106256:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193173248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836474.106306:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193173248:12345-0@lo:400:kworker.0 Request processed in 52us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836474.106310:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787836474.106484:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3f5dc0b40 x1874682193173248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836474.106498:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193173248:0@lo:400:kworker.0 00000100:00080000:0.0:1787836474.106901:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836474.107416:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193173120:0@lo:400:kworker.0 00000100:00100000:1.0:1787836474.107490:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836474.108554:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193173120 00000100:00100000:2.0:1787836474.108565:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193173120 00000100:00080000:0.0:1787836474.110160:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836474.110246:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787836474.110264:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193173120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836474.110371:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193173120:12345-0@lo:400:kworker.0 Request processed in 115us (2881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836474.110377:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787836474.110476:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193173120:0@lo:400:kworker.0 00010000:00010000:0.0:1787836474.542224:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836474.606860:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836474.606897:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193173376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836474.606983:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836474.607326:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193173376 00000100:00100000:0.0:1787836474.607335:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193173376 00000100:00100000:0.0:1787836474.607407:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787836474.607418:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193173376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836474.607451:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836474.607505:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193173376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836474.607530:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787836474.607677:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeaf2d00 x1874682193173376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836474.607699:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193173376:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787836475.276282:0:11470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:14:32 (1787836472) === 00000100:00100000:0.0:1787836475.541530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836475.541596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836475.541639:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172162816 00000100:00100000:0.0:1787836475.541650:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172162816 00000100:00100000:0.0:1787836475.541713:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:0.0:1787836475.541723:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:9697:x1874682172162816:12345-192.168.203.25@tcp:700:mkdir.0 00000100:00100000:0.0:1787836475.541804:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:9697:x1874682172162816:12345-192.168.203.25@tcp:700:mkdir.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836475.541812:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00080000:0.0:1787836475.541833:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836475.541878:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172162688 00000100:00100000:3.0:1787836475.541882:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172162688 00000100:00100000:3.0:1787836475.541919:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:3.0:1787836475.541928:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172162688:12345-192.168.203.25@tcp:41:mkdir.0 00000004:00000024:3.0:1787836475.541976:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787836475.542683:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172162688:12345-192.168.203.25@tcp:41:mkdir.0 Request processed in 752us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836475.542691:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:0.0:1787836475.553209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836475.553251:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172163072 00000100:00100000:0.0:1787836475.553260:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172163072 00000100:00100000:0.0:1787836475.553307:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1787836475.554007:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:9697:x1874682172163072:12345-192.168.203.25@tcp:36:mkdir.0 00010000:00010000:0.0:1787836475.554503:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836475.554567:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c13a0c00/0x966835ea68ab7478 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddb5 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.554588:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:0.0:1787836475.554600:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836475.554922:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.554938:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.554960:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.554991:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.555000:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.555007:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836475.559134:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787836475.559153:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.559164:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.559172:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.559179:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836475.559184:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.559192:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.559210:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4a00) 00010000:00010000:0.0:1787836475.559214:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836475.559227:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.559234:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7597 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787836475.559255:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076730481 reply state 0000000039b7e91c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836475.559264:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787836475.563779:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:9697:x1874682172163072:12345-192.168.203.25@tcp:36:mkdir.0 Request processed in 9768us (10571us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787836475.563793:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00010000:00010000:3.0:1787836475.569257:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836475.569933:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.569952:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.569961:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.569968:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836475.569973:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.569980:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.570002:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98e3d81a4200) 00010000:00010000:3.0:1787836475.570005:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836475.570010:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.570016:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab759e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836475.587599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836475.587698:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172163200 00000100:00100000:3.0:1787836475.587725:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172163200 00000100:00100000:3.0:1787836475.587788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1787836475.587798:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:9698:x1874682172163200:12345-192.168.203.25@tcp:101:chmod.0 00010000:00010000:3.0:1787836475.587819:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836475.587843:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.587909:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab75ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.587922:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab75ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.587934:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab75ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836475.588009:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787836475.588014:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836475.588055:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab75ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.588131:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede3a expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.588146:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab75ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede3a expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.588153:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836475.588156:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787836475.588159:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac400, rc 0) 00000100:00100000:3.0:1787836475.588220:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:9698:x1874682172163200:12345-192.168.203.25@tcp:101:chmod.0 Request processed in 424us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836475.588226:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:2.0:1787836475.595738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836475.599426:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172163456 00000100:00100000:0.0:1787836475.599441:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172163456 00000100:00100000:0.0:1787836475.599591:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:0.0:1787836475.599605:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:9698:x1874682172163456:12345-192.168.203.25@tcp:36:chmod.0 00010000:00010000:0.0:1787836475.599681:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836475.599713:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab75ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede3a expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.599733:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:0.0:1787836475.599745:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836475.599769:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.599792:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.599803:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787836475.600197:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bddcad1 reply state 00000000534d9c99 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836475.600208:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787836475.600222:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787836475.600348:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:9698:x1874682172163456:12345-192.168.203.25@tcp:36:chmod.0 Request processed in 745us (4617us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787836475.600356:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00010000:00010000:0.0:1787836475.603630:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.603649:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.603657:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.603662:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836475.603667:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.603674:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.603689:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4a00) 00010000:00010000:0.0:1787836475.603693:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787836475.603697:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.603703:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab75b3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836475.642557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836475.642798:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172163584 00000100:00100000:3.0:1787836475.642807:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172163584 00000100:00100000:3.0:1787836475.642871:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1787836475.642881:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:9699:x1874682172163584:12345-192.168.203.25@tcp:101:chown.0 00010000:00010000:3.0:1787836475.642904:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836475.642926:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede41 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.642994:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab75c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.643009:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab75c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.643019:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab75c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836475.643129:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787836475.643133:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836475.643176:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab75c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.643203:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede41 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.643220:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab75c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede41 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.643243:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836475.643247:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787836475.643250:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad200, rc 0) 00000100:00100000:3.0:1787836475.643313:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+8:9699:x1874682172163584:12345-192.168.203.25@tcp:101:chown.0 Request processed in 433us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836475.643321:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:1.0:1787836475.650482:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836475.651524:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172163712 00000100:00100000:3.0:1787836475.651535:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172163712 00000100:00100000:2.0:1787836475.655360:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836475.655383:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+8:9699:x1874682172163712:12345-192.168.203.25@tcp:101:chown.0 00010000:00010000:2.0:1787836475.655411:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836475.655442:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab75c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede48 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655529:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655545:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655557:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655572:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655578:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655585:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655720:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab75dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655729:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab75dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655737:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab75dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836475.655780:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787836475.655785:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836475.655812:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab75dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655824:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655830:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655836:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655843:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836475.655846:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655853:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655878:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836475.655887:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836475.655892:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655898:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655912:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655918:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655923:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655928:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836475.655931:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655937:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655944:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98e3c2410200) 00010000:00010000:2.0:1787836475.655947:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836475.655949:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655955:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.655987:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab75c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede48 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.656390:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab75dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede48 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.656399:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836475.656402:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836475.656404:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b800, rc 0) 00000100:00100000:2.0:1787836475.656518:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+9:9699:x1874682172163712:12345-192.168.203.25@tcp:101:chown.0 Request processed in 1141us (6045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836475.656527:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:1.0:1787836475.666858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836475.666957:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172163968 00000100:00100000:3.0:1787836475.666969:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172163968 00000100:00100000:3.0:1787836475.667040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1787836475.667098:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+9:9699:x1874682172163968:12345-192.168.203.25@tcp:36:chown.0 00010000:00010000:3.0:1787836475.667164:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836475.667191:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab75dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede48 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.667210:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:3.0:1787836475.667221:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836475.667249:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.667264:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.667274:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836475.698215:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fe79e47 reply state 00000000f0aedb93 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836475.698237:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787836475.698437:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787836475.698569:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+10:9699:x1874682172163968:12345-192.168.203.25@tcp:36:chown.0 Request processed in 31509us (31716us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787836475.698578:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000001:00080000:1.0:1787836475.698618:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1787836475.698644:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1787836475.698660:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.698669:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.698679:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.698686:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13acc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836475.698690:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.698712:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.698728:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3d224ad00) 00010000:00010000:1.0:1787836475.698731:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787836475.698736:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.698742:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab75e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836475.717372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836475.717642:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172164096 00000100:00100000:2.0:1787836475.717653:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172164096 00000100:00100000:2.0:1787836475.717716:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1787836475.717727:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:9700:x1874682172164096:12345-192.168.203.25@tcp:101:touch.500 00010000:00010000:2.0:1787836475.717751:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836475.717773:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab75eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede4f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787836475.718967:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1146us 00010000:00010000:2.0:1787836475.734008:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734030:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734042:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734092:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734108:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734116:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734606:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ba00/0x966835ea68ab7600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734616:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ba00/0x966835ea68ab7600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734622:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ba00/0x966835ea68ab7600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836475.734700:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787836475.734705:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836475.734800:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ba00/0x966835ea68ab7600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734816:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734822:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734828:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734835:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836475.734839:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734852:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734882:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836475.734885:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836475.734890:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734896:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab75f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734909:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734915:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734921:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734926:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836475.734929:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734935:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734942:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98e3c2410200) 00010000:00010000:2.0:1787836475.734945:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836475.734948:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.734962:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab75f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.735017:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab75eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede4f expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.735033:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ba00/0x966835ea68ab7600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede4f expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.735041:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410700) 00010000:00010000:2.0:1787836475.735043:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787836475.735045:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005ba00, rc 0) 00000100:00100000:2.0:1787836475.735175:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:9700:x1874682172164096:12345-192.168.203.25@tcp:101:touch.500 Request processed in 17448us (17809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836475.735186:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1787836475.740237:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836475.740296:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172164352 00000100:00100000:0.0:1787836475.740306:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172164352 00000100:00100000:0.0:1787836475.740360:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:0.0:1787836475.740368:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:9700:x1874682172164352:12345-192.168.203.25@tcp:101:touch.500 00010000:00010000:0.0:1787836475.740387:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836475.740404:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7607 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede56 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.740711:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.740726:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.740737:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.740779:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.740787:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.740793:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787836475.741632:0:10086:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787836475.741893:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab761c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.741911:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.741920:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab761c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.741952:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.741959:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.741965:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.741970:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836475.741974:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.741980:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.741992:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410700) 00010000:00010000:0.0:1787836475.741995:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836475.741999:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.742005:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab760e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787836475.742018:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed37a5ed reply state 000000004e7b0034 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836475.742033:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787836475.742091:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab7607 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede56 expref: 10 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.742105:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab761c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede56 expref: 9 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.742111:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e3d81a4900) 00010000:00010000:0.0:1787836475.742113:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836475.742115:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030800, rc 0) 00000100:00100000:0.0:1787836475.742182:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+10:9700:x1874682172164352:12345-192.168.203.25@tcp:101:touch.500 Request processed in 1813us (1956us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787836475.742191:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1787836475.746747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00010000:00010000:1.0:1787836475.747570:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.747587:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.747595:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.747602:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836475.747608:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.747615:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.747633:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xadf3d815 (ffff98e3d81a4a00) 00010000:00010000:1.0:1787836475.747636:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836475.747653:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.747660:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7615 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836475.748296:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172164608 00000100:00100000:0.0:1787836475.748311:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172164608 00000100:00100000:0.0:1787836475.748422:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:0.0:1787836475.748432:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:9700:x1874682172164608:12345-192.168.203.25@tcp:36:touch.500 00010000:00010000:0.0:1787836475.748496:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836475.748527:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab761c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede56 expref: 9 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.748540:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e3d81a4900) 00010000:00010000:0.0:1787836475.748548:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836475.748587:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.748600:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.748620:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787836475.748749:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac19d984 reply state 000000004dc57870 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836475.748758:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787836475.748873:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+10:9700:x1874682172164608:12345-192.168.203.25@tcp:36:touch.500 Request processed in 442us (2136us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787836475.748880:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00010000:00010000:3.0:1787836475.750801:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.750828:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.750836:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.750842:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836475.750847:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.750854:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.750880:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e3d81a4700) 00010000:00010000:3.0:1787836475.750884:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836475.750889:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.750894:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab762a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836475.752030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836475.752142:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172164736 00000100:00100000:1.0:1787836475.752152:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172164736 00000100:00100000:1.0:1787836475.752212:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:1.0:1787836475.752223:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+9:9700:x1874682172164736:12345-192.168.203.25@tcp:101:touch.500 00010000:00010000:1.0:1787836475.752244:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836475.752264:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede5d expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.752324:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede5d expref: 10 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.752338:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede5d expref: 10 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.752356:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:1.0:1787836475.752359:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787836475.752363:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5a00, rc 0) 00000100:00100000:1.0:1787836475.752417:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+10:9700:x1874682172164736:12345-192.168.203.25@tcp:101:touch.500 Request processed in 197us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836475.752424:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:1.0:1787836475.756296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836475.756415:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172164864 00000100:00100000:0.0:1787836475.756424:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172164864 00000100:00100000:0.0:1787836475.756471:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:0.0:1787836475.756479:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1874682172164864:12345-192.168.203.25@tcp:8:touch.500 00010000:00080000:0.0:1787836475.756523:0:10087:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:0.0:1787836475.756553:0:10087:0:(genops.c:1385:class_connect()) connect: client 2cd520e4-f240-41e5-b585-08ee5ec96478, cookie 0x966835ea68ab7638 00002000:00100000:0.0:1787836475.756564:0:10087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2cd520e4-f240-41e5-b585-08ee5ec96478/ffff98e401cf4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787836475.756590:0:10087:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:0.0:1787836475.756818:0:10087:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787836475.756847:0:10087:0:(import.c:65:import_set_state_nolock()) ffff98e401cf6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787836475.756939:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2360:x1874682172164864:12345-192.168.203.25@tcp:8:touch.500 Request processed in 459us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836475.756948:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1787836475.759793:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836475.759903:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172164992 00000100:00100000:1.0:1787836475.759915:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172164992 00000100:00100000:1.0:1787836475.760026:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1787836475.760038:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:0:x1874682172164992:12345-192.168.203.25@tcp:2:touch.500 00000100:00080000:0.0:1787836475.760665:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787836475.788572:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000001:00080000:0.0:1787836475.788589:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1787836475.789219:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:0:x1874682172164992:12345-192.168.203.25@tcp:2:touch.500 Request processed in 29174us (29429us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787836475.789234:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:2.0:1787836475.791673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836475.791763:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172165248 00000100:00100000:3.0:1787836475.791773:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172165248 00000100:00100000:3.0:1787836475.791870:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:3.0:1787836475.791881:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+10:9700:x1874682172165248:12345-192.168.203.25@tcp:35:touch.500 00000100:00100000:3.0:1787836475.792581:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+11:9700:x1874682172165248:12345-192.168.203.25@tcp:35:touch.500 Request processed in 697us (914us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787836475.792602:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:1.0:1787836475.803585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836475.803695:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172165376 00000100:00100000:2.0:1787836475.803708:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172165376 00000100:00100000:2.0:1787836475.803777:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1787836475.803788:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+11:9701:x1874682172165376:12345-192.168.203.25@tcp:101:rm.0 00010000:00010000:2.0:1787836475.803816:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836475.803839:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab763f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede64 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.803950:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.803965:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.803978:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836475.804080:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787836475.804084:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836475.804125:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.804152:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab763f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede64 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.804166:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede64 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.804174:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410700) 00010000:00010000:2.0:1787836475.804177:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836475.804181:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005bc00, rc 0) 00000100:00100000:2.0:1787836475.804251:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+12:9701:x1874682172165376:12345-192.168.203.25@tcp:101:rm.0 Request processed in 464us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836475.804257:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1787836475.808710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836475.808814:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172165632 00000100:00100000:1.0:1787836475.808824:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172165632 00000100:00100000:1.0:1787836475.808894:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:1.0:1787836475.808904:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+12:9701:x1874682172165632:12345-192.168.203.25@tcp:101:rm.0 00010000:00010000:1.0:1787836475.808927:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836475.808949:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab764d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede6b expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836475.809114:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787836475.809265:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab764d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede6b expref: 14 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.809280:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836475.809283:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836475.809289:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab764d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede6b expref: 14 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.809303:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5000, rc 0) 00000100:00100000:1.0:1787836475.809481:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+13:9701:x1874682172165632:12345-192.168.203.25@tcp:101:rm.0 Request processed in 578us (782us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787836475.809488:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:3.0:1787836475.814007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836475.814192:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172165760 00000100:00100000:2.0:1787836475.814201:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172165760 00000100:00100000:2.0:1787836475.814260:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:2.0:1787836475.814268:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:9701:x1874682172165760:12345-192.168.203.25@tcp:37:rm.0 00000100:00100000:2.0:1787836475.818760:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:9701:x1874682172165760:12345-192.168.203.25@tcp:37:rm.0 Request processed in 4484us (4753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836475.818773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:1.0:1787836475.822422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836475.822523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172166016 00000100:00100000:3.0:1787836475.822534:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172166016 00000100:00100000:3.0:1787836475.822620:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:3.0:1787836475.822630:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93cfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+13:9701:x1874682172166016:12345-192.168.203.25@tcp:35:rm.0 00000100:00100000:3.0:1787836475.822878:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93cfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:9701:x1874682172166016:12345-192.168.203.25@tcp:35:rm.0 Request processed in 249us (463us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787836475.822885:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:2.0:1787836475.826208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836475.826300:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172166272 00000100:00100000:0.0:1787836475.826309:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172166272 00000100:00100000:0.0:1787836475.826395:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:0.0:1787836475.826405:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+14:9701:x1874682172166272:12345-192.168.203.25@tcp:101:rm.0 00010000:00010000:0.0:1787836475.826427:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836475.826447:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab765b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.826637:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7662 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.826652:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.826664:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836475.826675:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787836475.826792:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab765b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede72 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.826808:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede72 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.826816:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410700) 00010000:00010000:0.0:1787836475.826819:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787836475.826822:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031a00, rc 0) 00000100:00100000:0.0:1787836475.826945:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+16:9701:x1874682172166272:12345-192.168.203.25@tcp:101:rm.0 Request processed in 542us (744us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787836475.826968:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:1.0:1787836475.829796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836475.829897:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172166400 00000100:00100000:2.0:1787836475.829907:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172166400 00000100:00100000:2.0:1787836475.829961:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:2.0:1787836475.829970:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+16:9701:x1874682172166400:12345-192.168.203.25@tcp:41:rm.0 00000004:00000024:2.0:1787836475.830025:0:10086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787836475.830129:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+16:9701:x1874682172166400:12345-192.168.203.25@tcp:41:rm.0 Request processed in 160us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836475.830136:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:1.0:1787836475.832685:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836475.832810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172166528 00000100:00100000:2.0:1787836475.832821:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172166528 00000100:00100000:2.0:1787836475.832893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:2.0:1787836475.832904:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+16:9701:x1874682172166528:12345-192.168.203.25@tcp:101:rm.0 00010000:00010000:2.0:1787836475.832927:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836475.832953:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7670 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833030:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833100:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833128:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833147:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833155:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833162:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833283:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833292:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833298:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836475.833326:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787836475.833330:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836475.833348:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833362:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833370:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833387:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833394:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833401:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836475.833406:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833415:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833427:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410700) 00010000:00010000:2.0:1787836475.833430:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836475.833435:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833442:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833455:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833461:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833467:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833472:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005ae00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836475.833482:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833488:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833496:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xadf3d815 (ffff98e3c2410000) 00010000:00010000:2.0:1787836475.833498:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836475.833514:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833521:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab767e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833816:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7670 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede79 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833833:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede79 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.833841:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:2.0:1787836475.833843:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836475.833846:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b800, rc 0) 00000100:00100000:2.0:1787836475.833977:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+17:9701:x1874682172166528:12345-192.168.203.25@tcp:101:rm.0 Request processed in 1075us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836475.833986:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:3.0:1787836475.837684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836475.837914:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172166784 00000100:00100000:1.0:1787836475.837924:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172166784 00000100:00100000:1.0:1787836475.837979:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:1.0:1787836475.837988:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+17:9701:x1874682172166784:12345-192.168.203.25@tcp:36:rm.0 00010000:00010000:1.0:1787836475.838051:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787836475.838348:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede79 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838368:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede5d expref: 16 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838378:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:1.0:1787836475.838391:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede64 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838398:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410700) 00010000:00010000:1.0:1787836475.838401:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836475.838420:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838433:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838442:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838453:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838459:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838479:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838713:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838722:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.838730:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787836475.840400:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787836475.840416:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324273356956ns, next at 325273353496ns, rc = 0 00010000:00010000:1.0:1787836475.840488:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840514:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840526:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840535:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840613:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840621:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840700:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787836475.840721:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840728:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840734:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840740:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836475.840744:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840752:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840763:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e3d1431800) 00010000:00010000:1.0:1787836475.840766:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787836475.840770:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840776:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab769a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840793:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840799:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840804:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840814:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836475.840817:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840823:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840830:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410700) 00010000:00010000:1.0:1787836475.840832:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836475.840835:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.840840:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab768c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836475.840849:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000188bb5e3 reply state 00000000646a90c1 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836475.840857:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836475.840966:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+16:9701:x1874682172166784:12345-192.168.203.25@tcp:36:rm.0 Request processed in 2974us (3287us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787836475.840975:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00010000:00010000:3.0:1787836475.844464:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.844485:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.844494:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.844500:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836475.844518:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.844526:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.844549:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xadf3d815 (ffff98e3d1431600) 00010000:00010000:3.0:1787836475.844565:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836475.844571:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.844577:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7693 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xadf3d815 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836475.846037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836475.846163:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172167040 00000100:00100000:2.0:1787836475.846173:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172167040 00000100:00100000:2.0:1787836475.846223:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:2.0:1787836475.846232:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+15:9701:x1874682172167040:12345-192.168.203.25@tcp:35:rm.0 00000100:00100000:2.0:1787836475.846488:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+16:9701:x1874682172167040:12345-192.168.203.25@tcp:35:rm.0 Request processed in 257us (459us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787836475.846496:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:1.0:1787836475.849476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836475.849639:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172167296 00000100:00100000:2.0:1787836475.849650:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172167296 00000100:00100000:2.0:1787836475.849715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:2.0:1787836475.849724:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+16:9701:x1874682172167296:12345-192.168.203.25@tcp:36:rm.0 00010000:00010000:2.0:1787836475.849784:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787836475.849811:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab7662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede72 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.849831:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ba00/0x966835ea68ab7600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede4f expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.849842:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410700) 00010000:00010000:2.0:1787836475.849856:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab75c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede41 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.849865:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836475.849884:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836475.849906:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.849919:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.849929:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.849957:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.849964:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.849971:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.850309:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.850318:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.850325:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.851239:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836475.851249:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.851257:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5c00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836475.851261:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.851269:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.851281:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98e3d1431800) 00010000:00010000:0.0:1787836475.851284:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787836475.851288:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836475.851295:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab76a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836475.851537:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836475.851539:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836475.851550:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:2.0:1787836475.852331:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787836475.852349:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852359:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852366:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852372:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836475.852376:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852394:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852405:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98e3c2410900) 00010000:00010000:2.0:1787836475.852408:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787836475.852412:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852418:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab76b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852438:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852443:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852449:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852454:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836475.852457:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852462:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852468:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836475.852470:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836475.852473:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836475.852488:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab76a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836475.852515:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f013d129 reply state 00000000895baf28 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836475.852524:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787836475.852794:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+15:9701:x1874682172167296:12345-192.168.203.25@tcp:36:rm.0 Request processed in 3067us (3325us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787836475.852803:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00010000:00010000:3.0:1787836475.864980:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.864999:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.865012:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.865019:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005ae00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836475.865024:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.865032:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.865050:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98e3c2410200) 00010000:00010000:3.0:1787836475.865053:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836475.865332:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836475.865340:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab76af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836476.143530:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeace1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193173504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836476.143612:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836476.143861:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193173504 00000100:00100000:3.0:1787836476.143881:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193173504 00000100:00100000:3.0:1787836476.143941:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787836476.143952:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193173504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787836476.143978:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787836476.144047:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836476.147642:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193173504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3683us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836476.147659:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787836476.148408:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3eeace1c0 x1874682193173504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836476.148458:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeace1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193173504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787836476.592116:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836477.037197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836477.037241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836477.037281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836477.037304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836477.037344:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172167552 00000100:00100000:1.0:1787836477.037355:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172167552 00000100:00100000:1.0:1787836477.037422:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172167808 00000100:00100000:1.0:1787836477.037426:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172167808 00000100:00100000:1.0:1787836477.037450:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 107 00000100:00100000:1.0:1787836477.037460:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:2361:x1874682172167552:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836477.037780:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172167424 00000100:00100000:0.0:1787836477.037785:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172167424 00000100:00100000:0.0:1787836477.037828:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 253 00000100:00100000:0.0:1787836477.037837:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172167424:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836477.037872:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172167424:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836477.037880:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 253 00000100:00100000:2.0:1787836477.037886:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172167680 00000100:00100000:2.0:1787836477.037892:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172167680 00000100:00100000:2.0:1787836477.037933:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:2.0:1787836477.037941:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172167680:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836477.037967:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:2361:x1874682172167552:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 180us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836477.037974:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172167680:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 33us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836477.037985:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 107 00000100:00100000:2.0:1787836477.037986:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:1.0:1787836477.038015:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00100000:1.0:1787836477.038037:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172167808:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836477.038474:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172167808:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 438us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836477.038481:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00080000:1.0:1787836477.038513:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836477.038519:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787836477.618119:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836478.638287:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836479.218253:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193174016:0@lo:400:kworker.0 00000100:00100000:3.0:1787836479.218330:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836479.218399:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787836479.218405:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193173632:0@lo:400:kworker.0 00000100:00100000:3.0:1787836479.218436:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836479.218459:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193174144:0@lo:400:kworker.0 00000100:00100000:3.0:1787836479.218497:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836479.218528:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193173632 00000100:00100000:3.0:1787836479.218534:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193173632 00000100:00100000:3.0:1787836479.219212:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787836479.219226:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193173632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836479.219286:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193173632:12345-0@lo:400:kworker.0 Request processed in 65us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836479.219293:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787836479.219349:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193173632:0@lo:400:kworker.0 00000100:00100000:0.0:1787836479.219430:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193174016 00000100:00100000:0.0:1787836479.219449:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193174016 00000100:00100000:0.0:1787836479.219508:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787836479.219518:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193174016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836479.219559:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193174016:12345-0@lo:400:kworker.0 Request processed in 44us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836479.219565:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787836479.220047:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193173760:0@lo:400:kworker.0 00000100:00100000:1.0:1787836479.220131:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836479.220160:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193174272:0@lo:400:kworker.0 00000100:00100000:1.0:1787836479.220192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836479.220213:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836479.220220:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c22df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193173888:0@lo:400:kworker.0 00000100:00100000:1.0:1787836479.220246:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836479.220278:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193174144 00000100:00100000:1.0:1787836479.220284:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193174144 00000100:00100000:1.0:1787836479.220314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193173760 00000100:00100000:1.0:1787836479.220317:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193173760 00000100:00100000:1.0:1787836479.220328:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193173888 00000100:00100000:1.0:1787836479.220331:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193173888 00000100:00100000:1.0:1787836479.220347:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787836479.220354:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193174144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836479.220408:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193174144:12345-0@lo:400:kworker.0 Request processed in 54us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836479.220414:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787836479.220429:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787836479.220434:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193173760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836479.220465:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193173760:12345-0@lo:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836479.220471:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787836479.220496:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787836479.220502:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193173888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836479.220529:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193173888:12345-0@lo:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836479.220534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787836479.220567:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c22df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193173888:0@lo:400:kworker.0 00000100:00100000:1.0:1787836479.220599:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193173760:0@lo:400:kworker.0 00000100:00100000:2.0:1787836479.221612:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193174272 00000100:00100000:2.0:1787836479.221621:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193174272 00000100:00100000:2.0:1787836479.221672:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787836479.221687:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193174272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836479.221755:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193174272:12345-0@lo:400:kworker.0 Request processed in 76us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836479.221762:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1787836479.221799:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d144b480 x1874682193174272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836479.221825:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193174272:0@lo:400:kworker.0 00000100:00080000:3.0:1787836479.221914:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787836479.221920:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836479.221931:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836479.221962:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d1448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193174144:0@lo:400:kworker.0 00010000:00080000:3.0:1787836479.221976:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401fba1c0 x1874682193174016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836479.221985:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193174016:0@lo:400:kworker.0 00010000:00010000:3.0:1787836479.662824:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836479.736449:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836479.736486:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193174400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836479.736573:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836479.736693:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193174400 00000100:00100000:0.0:1787836479.736702:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193174400 00000100:00100000:0.0:1787836479.736766:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787836479.736777:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193174400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836479.736817:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836479.736866:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193174400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836479.736874:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787836479.736916:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3d144b480 x1874682193174400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836479.736937:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193174400:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787836479.849563:0:11620:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787836480.691912:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787836480.814999:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:2.0:1787836480.815034:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787836480.815041:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787836480.815087:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1787836480.815481:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836480.815510:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c8288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193174528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787836480.815596:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836480.815816:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193174528 00000100:00100000:1.0:1787836480.815823:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193174528 00000100:00100000:1.0:1787836480.815882:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787836480.815892:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193174528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787836480.815925:0:6691:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787836480.815969:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a90383a, atime: 0x6a90383a, ctime: 0x6a90383a, blocks: 0x1 00010000:00010000:1.0:1787836480.815980:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836480.816001:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1787836480.816008:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836480.816299:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836480.816325:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836480.816339:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836480.816348:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836480.816408:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787836480.816747:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836480.816754:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836480.816762:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836480.816766:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836480.816776:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836480.816794:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836480.816801:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bffc25d5/0x966835ea68ab76bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836480.816840:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836480.816842:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836480.816844:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836480.817607:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193174528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1711us (2008us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787836480.817621:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1787836480.817824:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e3c8288000/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787836480.817839:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c8288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193174528:0@lo:6:osp-syn-0-0.0 00000020:00000080:1.0:1787836481.033292:0:11669:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb84102c0 20000000:00000080:1.0:1787836481.033317:0:11669:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e3fafec400 uarg=0000000000000000 20000000:01000000:1.0:1787836481.033362:0:11669:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787836481.033368:0:11669:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787836481.033373:0:11669:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787836481.037802:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787836481.038114:0:11669:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787836481.050368:0:11669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787836481.050437:0:11669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787836481.050513:0:11669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787836481.050530:0:11669:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787836481.050549:0:11669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050568:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab755f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050576:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab756d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050583:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab757b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050593:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050614:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050622:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050656:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050670:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.050683:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c828b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193174656:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836481.050905:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050914:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.050923:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c8288780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193174784:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836481.050980:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab757b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.050988:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab757b expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.050997:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c8288f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193174912:0@lo:104: 00000100:00100000:1.0:1787836481.051038:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787836481.054772:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab756d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.054789:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab756d expref: 18 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.054804:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c8289680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193175040:0@lo:104: 00000100:00100000:1.0:1787836481.054869:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787836481.054901:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab755f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836481.054909:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab755f expref: 18 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.054916:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c828a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193175168:0@lo:104: 00000100:00100000:0.0:1787836481.054917:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193174912 00000100:00100000:0.0:1787836481.054925:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193174912 00000100:00100000:1.0:1787836481.054941:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836481.054951:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583000 going to sleep for 11 seconds 00000100:00100000:0.0:1787836481.054979:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787836481.054991:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193175040 00000100:00100000:0.0:1787836481.054994:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193175040 00000100:00100000:0.0:1787836481.055007:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193175168 00000100:00100000:0.0:1787836481.055009:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193175168 00000100:00100000:0.0:1787836481.055023:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787836481.055031:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8288b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:11669:x1874682193174912:12345-0@lo:104: 00010000:00010000:0.0:1787836481.055044:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055169:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836481.055176:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8288b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+5:11669:x1874682193174912:12345-0@lo:104: Request processed in 146us (4138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836481.055183:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787836481.055200:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787836481.055206:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787836481.055207:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c82883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:11669:x1874682193175040:12345-0@lo:104: 00010000:00010000:3.0:1787836481.055213:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055214:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055222:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a800 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:3.0:1787836481.055226:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055234:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787836481.055242:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836481.055248:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787836481.055250:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836481.055254:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c82883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+4:11669:x1874682193175040:12345-0@lo:104: Request processed in 49us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836481.055260:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787836481.055271:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787836481.055276:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:11669:x1874682193175168:12345-0@lo:104: 00010000:00010000:3.0:1787836481.055278:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055283:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836481.055283:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055304:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055311:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005a800/0x966835ea68ab757b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7582 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055312:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787836481.055316:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+3:11669:x1874682193175168:12345-0@lo:104: Request processed in 40us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836481.055322:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787836481.055329:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787836481.055333:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055339:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005aa00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:3.0:1787836481.055342:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055348:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787836481.055354:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836481.055359:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787836481.055370:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836481.055373:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055374:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055379:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836481.055391:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836481.055394:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055395:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055401:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055402:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab756d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7574 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836481.055408:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055411:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836481.055413:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787836481.055413:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787836481.055414:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836481.055426:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193175296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787836481.055426:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055431:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836481.055436:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055442:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab755f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab7566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055454:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836481.055456:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836481.055458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787836481.055458:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836481.055464:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836481.055486:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193175296 00000100:00100000:0.0:1787836481.055489:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193175296 00010000:00010000:0.0:1787836481.055505:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab757b expref: 19 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836481.055508:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193175424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787836481.055531:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836481.055539:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193175424 00000100:00100000:0.0:1787836481.055541:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193175424 00000100:00100000:3.0:1787836481.055547:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787836481.055552:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193175552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787836481.055552:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab756d expref: 20 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836481.055570:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787836481.055572:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836481.055576:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+20:3311:x1874682193175296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787836481.055585:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836481.055590:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab757b expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836481.055595:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193175552 00000100:00100000:3.0:1787836481.055598:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193175552 00010000:00010000:0.0:1787836481.055600:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab757b expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055611:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab755f expref: 21 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836481.055625:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1787836481.055626:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836481.055631:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+21:3312:x1874682193175424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787836481.055638:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836481.055641:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab756d expref: 21 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.055649:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab756d expref: 21 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836481.055653:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+21:3311:x1874682193175296:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (195us total) trans 0 rc 0/0 00010000:00010000:3.0:1787836481.055659:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836481.055659:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787836481.055671:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787836481.055677:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8601050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+20:3312:x1874682193175552:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787836481.055682:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+20:3312:x1874682193175424:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1787836481.055684:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787836481.055688:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1787836481.055688:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab755f expref: 20 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055696:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab755f expref: 19 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.055705:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836481.055718:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193175424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787836481.055729:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8601050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193175552:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836481.055733:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193175552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787836481.055735:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787836481.055795:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193175296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787836481.056030:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ad000/0x966835ea68ab7582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab757b expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.056040:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c8288f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193174912:0@lo:104: 00010000:00010000:1.0:1787836481.056049:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ac800/0x966835ea68ab7574 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab756d expref: 17 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.056087:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c8289680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193175040:0@lo:104: 00010000:00010000:1.0:1787836481.056098:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab7566 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab755f expref: 16 pid: 5836 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.056105:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c828a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193175168:0@lo:104: 00000100:00100000:1.0:1787836481.060441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836481.060586:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172167936 00000100:00100000:3.0:1787836481.060603:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172167936 00010000:00010000:3.0:1787836481.060646:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836481.060689:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1787836481.060699:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2363:x1874682172167936:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836481.060714:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836481.060720:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.060736:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836481.060760:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836481.060814:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2363:x1874682172167936:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 116us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836481.060822:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00010000:00010000:2.0:1787836481.061263:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab7590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede33 expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836481.061284:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c828b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193174656:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836481.061304:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c8288780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11669:1874682193174784:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836481.061341:0:11669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836481.063337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836481.063427:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172168064 00000100:00100000:0.0:1787836481.063436:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172168064 00010000:00010000:0.0:1787836481.063509:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836481.063552:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:0.0:1787836481.063562:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c82892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:2363:x1874682172168064:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836481.063577:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836481.063583:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063596:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063623:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ac600/0x966835ea68ab7589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede2c expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063640:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063648:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063664:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063688:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063694:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063701:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063707:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836481.063711:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063719:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063740:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836481.063750:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836481.063818:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c82892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:2363:x1874682172168064:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 257us (488us total) trans 0 rc 0/0 00010000:00010000:2.0:1787836481.063824:0:11669:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836481.063840:0:11669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836481.063846:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab76c4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836481.064140:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:3.0:1787836481.272784:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787836481.272805:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193175680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836481.272867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836481.272945:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193175680 00000100:00100000:2.0:1787836481.272953:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193175680 00000100:00100000:2.0:1787836481.273030:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787836481.273041:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193175680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836481.273183:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836481.273237:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193175680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836481.273246:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787836481.281228:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836481.287762:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193175680:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787836481.367810:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1787836481.711386:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836482.153797:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836482.153844:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836482.153878:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172168192 00000100:00100000:1.0:1787836482.153886:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836482.153889:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172168192 00000100:00100000:3.0:1787836482.153908:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172168448 00000100:00100000:3.0:1787836482.153915:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172168448 00000100:00100000:1.0:1787836482.153928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836482.153951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 255 00000100:00100000:1.0:1787836482.153962:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172168320 00000100:00100000:2.0:1787836482.153963:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:2364:x1874682172168192:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836482.153969:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172168320 00000100:00100000:3.0:1787836482.153972:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:3.0:1787836482.153984:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172168448:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836482.154010:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172168576 00000100:00100000:1.0:1787836482.154015:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172168576 00000100:00100000:2.0:1787836482.154038:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:2364:x1874682172168192:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.154039:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172168448:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836482.154046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 112 00000100:00100000:2.0:1787836482.154051:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 255 00000100:00100000:3.0:1787836482.154093:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00080000:3.0:1787836482.154115:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836482.154120:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836482.154154:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:3.0:1787836482.154167:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8289a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172168576:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836482.154168:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8289e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172168320:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836482.154203:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8289a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172168576:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 42us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.154214:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:1.0:1787836482.154215:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8289e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172168320:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 156us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836482.154226:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 112 10000000:01000000:2.0:1787836482.478381:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787836482.478390:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e2c1c4b800 from 7 10000000:01000000:2.0:1787836482.478396:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787836482.478655:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836482.478668:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836482.478679:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836482.478704:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193175808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787836482.478774:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836482.478851:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d06d1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.479148:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193175808 00000100:00100000:3.0:1787836482.479156:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193175808 00000100:00100000:3.0:1787836482.479257:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787836482.479269:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:5839:x1874682193175808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836482.479282:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836482.479309:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ad600/0x966835ea68ab76d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab76cb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.479334:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ad600/0x966835ea68ab76d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab76cb expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.479345:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ad600/0x966835ea68ab76d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab76cb expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.479355:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad600, rc 0) 00000100:00100000:3.0:1787836482.479413:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193175808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.479427:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787836482.479516:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193175808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836482.479533:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836482.479542:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836482.479618:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193175936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836482.479648:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836482.480098:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836482.481530:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193175936 00000100:00100000:2.0:1787836482.481545:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193175936 00000100:00100000:2.0:1787836482.481614:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787836482.484496:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193175936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836482.484867:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193175936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3244us (5218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836482.484878:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787836482.485489:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193175936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836482.485552:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193176064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836482.485607:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836482.485650:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.486003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193176064 00000100:00100000:3.0:1787836482.486019:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193176064 00000100:00100000:3.0:1787836482.486099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787836482.486109:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193176064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.486633:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193176064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 524us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.486642:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787836482.487757:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193176064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836482.489737:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeacde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11683:1874682193176192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836482.489834:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836482.489884:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d06d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836482.490190:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193176192 00000100:00100000:0.0:1787836482.490198:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193176192 00000100:00100000:0.0:1787836482.490297:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787836482.490306:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:11683:x1874682193176192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836482.490550:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:11683:x1874682193176192:12345-0@lo:502:llog_process_th.0 Request processed in 244us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836482.490557:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787836482.490725:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeacde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11683:1874682193176192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787836482.491589:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787836482.491606:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836482.491608:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787836482.491616:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e2c1c4b800 00000020:00000080:2.0:1787836482.491619:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787836482.491728:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeacde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11683:1874682193176320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836482.491914:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836482.492592:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d06d1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.494753:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193176320 00000100:00100000:3.0:1787836482.494763:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193176320 00000100:00100000:3.0:1787836482.494819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787836482.494827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:11683:x1874682193176320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.495217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:11683:x1874682193176320:12345-0@lo:502:llog_process_th.0 Request processed in 389us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.495226:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787836482.495297:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeacde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11683:1874682193176320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787836482.495342:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836482.495351:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836482.495354:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787836482.495359:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787836482.495435:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787836482.495467:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787836482.495477:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836482.495489:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836482.495500:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787836482.495508:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3d01b2000 from 7 10000000:01000000:0.0:1787836482.495511:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787836482.495540:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836482.495549:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836482.495557:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836482.495575:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193176448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787836482.495611:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836482.495647:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.495666:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193176448 00000100:00100000:3.0:1787836482.495672:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193176448 00000100:00100000:3.0:1787836482.495701:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787836482.495708:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:5839:x1874682193176448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836482.495718:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836482.495731:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13adc00/0x966835ea68ab76e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab76d9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.495752:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13adc00/0x966835ea68ab76e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab76d9 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.495771:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13adc00/0x966835ea68ab76e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab76d9 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.495780:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13adc00, rc 0) 00000100:00100000:3.0:1787836482.495813:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193176448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.495820:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787836482.495856:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193176448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836482.495871:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.495880:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836482.496143:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193176576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.496173:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.496189:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.496202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193176576 00000100:00100000:3.0:1787836482.496205:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193176576 00000100:00100000:3.0:1787836482.496229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787836482.496236:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193176576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.496533:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193176576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.496540:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787836482.496602:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193176576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.496643:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193176704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.496685:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.496702:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.496718:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193176704 00000100:00100000:3.0:1787836482.496721:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193176704 00000100:00100000:3.0:1787836482.496749:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787836482.496756:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193176704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.496934:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193176704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.496941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787836482.497202:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193176704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.497475:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11685:1874682193176832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.497519:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.497539:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193176832 00000100:00100000:3.0:1787836482.497542:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193176832 00000100:00100000:3.0:1787836482.497563:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787836482.497619:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:11685:x1874682193176832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.497793:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:11685:x1874682193176832:12345-0@lo:502:llog_process_th.0 Request processed in 224us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.497800:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787836482.497840:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.497854:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11685:1874682193176832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787836482.497878:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836482.497889:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836482.497897:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787836482.498734:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e3d01b2000 00000020:00000080:3.0:1787836482.498738:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787836482.498820:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11685:1874682193176960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.499028:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.499092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193176960 00000100:00100000:3.0:1787836482.499098:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193176960 00000100:00100000:3.0:1787836482.499205:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787836482.499213:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:11685:x1874682193176960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.499735:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:11685:x1874682193176960:12345-0@lo:502:llog_process_th.0 Request processed in 520us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.499745:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787836482.499807:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.499827:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11685:1874682193176960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787836482.499868:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836482.499875:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836482.499878:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787836482.499882:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787836482.500132:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787836482.500152:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787836482.500164:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.500177:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836482.500187:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787836482.500190:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3ce1d0800 from 7 10000000:01000000:3.0:1787836482.500192:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787836482.500228:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.500236:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.500245:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836482.500263:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193177088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.500297:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.500319:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.500406:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193177088 00000100:00100000:3.0:1787836482.500412:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193177088 00000100:00100000:3.0:1787836482.500439:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787836482.500447:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:5839:x1874682193177088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836482.500467:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836482.500482:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab76ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab76e7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.500504:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab76ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab76e7 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.500514:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab76ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab76e7 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.500522:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad400, rc 0) 00000100:00100000:3.0:1787836482.500554:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193177088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.500561:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787836482.500602:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193177088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836482.500615:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.500624:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836482.500683:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193177216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.500708:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.500721:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.500732:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193177216 00000100:00100000:3.0:1787836482.500735:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193177216 00000100:00100000:3.0:1787836482.500756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787836482.500762:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193177216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.501429:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193177216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 664us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.501438:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787836482.501495:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193177216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.501529:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193177344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.501566:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.501581:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.501593:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193177344 00000100:00100000:3.0:1787836482.501596:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193177344 00000100:00100000:3.0:1787836482.501616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787836482.501621:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193177344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.501757:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:5839:x1874682193177344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.501770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787836482.501802:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e8e7a0a-4610-42c5-99e6-210da529f97c:5839:1874682193177344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.502178:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11687:1874682193177472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.502214:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.502236:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193177472 00000100:00100000:3.0:1787836482.502239:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193177472 00000100:00100000:3.0:1787836482.502262:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787836482.502268:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:11687:x1874682193177472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.502398:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:11687:x1874682193177472:12345-0@lo:502:llog_process_th.0 Request processed in 129us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.502405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787836482.502437:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.502451:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11687:1874682193177472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787836482.502482:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836482.502495:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836482.502497:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787836482.502504:0:11687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e3ce1d0800 00000020:00000080:3.0:1787836482.502507:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787836482.502888:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11687:1874682193177600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.502923:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836482.502948:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193177600 00000100:00100000:3.0:1787836482.502952:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193177600 00000100:00100000:3.0:1787836482.502977:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787836482.502983:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:11687:x1874682193177600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836482.503131:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:11687:x1874682193177600:12345-0@lo:502:llog_process_th.0 Request processed in 148us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.503144:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787836482.503173:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e565a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787836482.503187:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e8e7a0a-4610-42c5-99e6-210da529f97c:11687:1874682193177600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787836482.503206:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836482.503211:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836482.503212:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787836482.503217:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787836482.503272:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787836482.503288:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787836482.503297:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.503308:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787836482.525005:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787836482.734311:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836482.923115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836482.923252:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172168704 00000100:00100000:3.0:1787836482.923272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172168704 00000100:00100000:3.0:1787836482.923335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 271 00000100:00100000:3.0:1787836482.923345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:5601:x1874682172168704:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836482.923361:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836482.923377:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab76f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede80 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.923407:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab76f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede80 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.923418:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab76f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede80 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836482.923447:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac000, rc 0) 00000100:00100000:3.0:1787836482.923869:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172168704:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 524us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.923877:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 271 00000100:00100000:2.0:1787836482.940407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836482.940613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172168832 00000100:00100000:3.0:1787836482.940622:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172168832 00000100:00100000:3.0:1787836482.940687:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 272 00000100:00100000:3.0:1787836482.940698:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172168832:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.941005:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172168832:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 309us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.941013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 272 00000100:00100000:1.0:1787836482.951845:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836482.951926:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172168960 00000100:00100000:3.0:1787836482.951936:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172168960 00000100:00100000:3.0:1787836482.951996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 273 00000100:00100000:3.0:1787836482.952006:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172168960:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836482.952243:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172168960:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 238us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836482.952251:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 273 00000100:00100000:1.0:1787836482.956680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836482.956972:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172169088 00000100:00100000:0.0:1787836482.956983:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172169088 00000100:00100000:0.0:1787836482.957049:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 274 00000100:00100000:0.0:1787836482.957085:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:9971:x1874682172169088:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787836482.957347:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:9971:x1874682172169088:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 288us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836482.957355:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 274 00000100:00100000:2.0:1787836482.962313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836482.962413:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172169216 00000100:00100000:0.0:1787836482.962423:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172169216 00000100:00100000:0.0:1787836482.962487:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 275 00000100:00100000:0.0:1787836482.962497:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:9971:x1874682172169216:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787836482.962735:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:9971:x1874682172169216:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 239us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836482.962753:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 275 00000100:00100000:1.0:1787836482.967181:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836482.967967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172169344 00000100:00100000:0.0:1787836482.967977:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172169344 00000100:00100000:0.0:1787836482.968040:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 276 00000100:00100000:0.0:1787836482.968050:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:5601:x1874682172169344:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836482.968085:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836482.968102:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0031a00/0x966835ea68ab76fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede87 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836482.968130:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0031a00/0x966835ea68ab76fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede87 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836482.968141:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0031a00/0x966835ea68ab76fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede87 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836482.968150:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031a00, rc 0) 00000100:00100000:0.0:1787836482.968277:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172169344:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 228us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836482.968285:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 276 00000100:00100000:1.0:1787836482.975957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836482.976230:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172169472 00000100:00100000:3.0:1787836482.976240:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172169472 00000100:00100000:2.0:1787836482.976348:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 277 00000100:00100000:2.0:1787836482.976361:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c826fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172169472:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836482.976746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c826fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172169472:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 388us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836482.976754:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 277 00000100:00100000:2.0:1787836482.980707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836482.981092:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172169600 00000100:00100000:0.0:1787836482.981102:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172169600 00000100:00100000:0.0:1787836482.981156:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 278 00000100:00100000:0.0:1787836482.981166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172169600:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836482.984763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:5601:x1874682172169600:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 3584us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836482.984780:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 278 00000100:00100000:3.0:1787836482.996381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836482.996596:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172169728 00000100:00100000:1.0:1787836482.996606:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172169728 00000100:00100000:1.0:1787836482.996666:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 279 00000100:00100000:1.0:1787836482.996677:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:9974:x1874682172169728:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787836482.997052:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:9974:x1874682172169728:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 374us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836482.997102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 279 00000100:00100000:1.0:1787836482.999378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836482.999903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172169856 00000100:00100000:0.0:1787836482.999913:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172169856 00000100:00100000:0.0:1787836482.999973:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 280 00000100:00100000:0.0:1787836482.999983:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:9974:x1874682172169856:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787836483.000499:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:9974:x1874682172169856:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 516us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836483.000508:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 280 00000040:00080000:1.0:1787836483.566741:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787836483.758416:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836484.335879:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193177856:0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.335989:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836484.336326:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193178368:0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.336358:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836484.336407:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836484.336417:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193177984:0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.336565:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836484.336601:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193178112:0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.336626:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836484.336644:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787836484.336650:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193177728:0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.336676:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836484.336695:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193178240:0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.336716:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836484.336745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193177856 00000100:00100000:1.0:1787836484.336751:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193177856 00000100:00100000:1.0:1787836484.336787:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193177984 00000100:00100000:1.0:1787836484.336791:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193177984 00000100:00100000:1.0:1787836484.336812:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193178240 00000100:00100000:1.0:1787836484.336814:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193178240 00000100:00100000:1.0:1787836484.336830:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787836484.336837:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8288780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193177856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.336891:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8288780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193177856:12345-0@lo:400:kworker.0 Request processed in 54us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836484.336928:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787836484.336950:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787836484.336956:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193177984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.336985:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193177984:12345-0@lo:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836484.336991:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787836484.337001:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787836484.337006:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8288f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193178240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.337035:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8288f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193178240:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836484.337041:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787836484.337077:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193178368 00000100:00100000:1.0:1787836484.337081:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193178368 00000100:00100000:1.0:1787836484.337103:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193178112 00000100:00100000:1.0:1787836484.337105:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193178112 00000100:00100000:1.0:1787836484.337121:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787836484.337127:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193178368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.337157:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193178368:12345-0@lo:400:kworker.0 Request processed in 30us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836484.337163:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787836484.337174:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787836484.337180:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8289680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193178112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.337219:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8289680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193178112:12345-0@lo:400:kworker.0 Request processed in 39us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836484.337224:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787836484.337271:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193178240:0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.337281:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787836484.337286:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e3c8288000, transno 4294967300 00000100:00100000:1.0:1787836484.337296:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193178112:0@lo:400:kworker.0 00000100:00100000:2.0:1787836484.337408:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193177728 00000100:00100000:2.0:1787836484.337414:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193177728 00000100:00100000:2.0:1787836484.337464:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787836484.337471:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193177728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836484.337514:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193177728:12345-0@lo:400:kworker.0 Request processed in 44us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836484.337531:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787836484.337566:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193177728:0@lo:400:kworker.0 00000100:00080000:2.0:1787836484.337602:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787836484.337606:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787836484.337609:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836484.339085:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193177984:0@lo:400:kworker.0 00000100:00100000:1.0:1787836484.339103:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193177856:0@lo:400:kworker.0 00010000:00080000:1.0:1787836484.339116:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604d680 x1874682193178368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836484.339127:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193178368:0@lo:400:kworker.0 00010000:00010000:3.0:1787836484.782295:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836484.849358:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787836484.849392:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193178496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836484.849502:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836484.849978:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193178496 00000100:00100000:0.0:1787836484.849988:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193178496 00000100:00100000:0.0:1787836484.850078:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787836484.850089:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193178496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836484.850134:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836484.850198:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193178496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836484.850206:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787836484.850403:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604c3c0 x1874682193178496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836484.850425:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193178496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787836485.806639:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836486.383437:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836486.388227:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193178624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836486.388314:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836486.388399:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193178624 00000100:00100000:0.0:1787836486.388408:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193178624 00000100:00100000:0.0:1787836486.388479:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787836486.388489:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193178624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836486.388529:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836486.388579:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193178624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836486.388586:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787836486.388744:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193178624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787836486.388812:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787836486.838029:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836487.273439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836487.273482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836487.273517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836487.273575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836487.273841:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172170240 00000100:00100000:1.0:1787836487.273850:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172170240 00000100:00100000:1.0:1787836487.273924:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:1.0:1787836487.273935:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172170240:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836487.274023:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172170240:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 90us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836487.274030:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:1.0:1787836487.274093:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172170112 00000100:00100000:1.0:1787836487.274096:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172170112 00000100:00100000:1.0:1787836487.274121:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172170368 00000100:00100000:1.0:1787836487.274132:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172170368 00000100:00100000:1.0:1787836487.274157:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:1.0:1787836487.274164:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172170112:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836487.274194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172170112:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836487.274200:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:1.0:1787836487.274211:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:1.0:1787836487.274216:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172170368:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836487.274238:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172170368:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836487.274243:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00080000:3.0:1787836487.274993:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836487.274998:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836487.275176:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172169984 00000100:00100000:0.0:1787836487.275183:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172169984 00000100:00100000:0.0:1787836487.275234:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 282 00000100:00100000:0.0:1787836487.275253:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172169984:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836487.275308:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172169984:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 56us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836487.275315:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 282 00010000:00010000:3.0:1787836487.855916:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836488.879005:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836489.454870:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193178880:0@lo:400:kworker.0 00000100:00100000:0.0:1787836489.454944:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836489.455007:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193179392:0@lo:400:kworker.0 00000100:00100000:0.0:1787836489.455028:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836489.455056:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836489.455118:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193179008:0@lo:400:kworker.0 00000100:00100000:0.0:1787836489.455141:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836489.455170:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193179392 00000100:00100000:0.0:1787836489.455185:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193179392 00000100:00100000:0.0:1787836489.455231:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787836489.455239:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193179392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836489.455283:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193179392:12345-0@lo:400:kworker.0 Request processed in 45us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836489.455290:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1787836489.455322:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e401d1a940 x1874682193179392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836489.455335:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193179392:0@lo:400:kworker.0 00000100:00100000:1.0:1787836489.455585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193178880 00000100:00100000:1.0:1787836489.455589:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193178880 00000100:00100000:1.0:1787836489.455624:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193179008 00000100:00100000:1.0:1787836489.455627:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193179008 00000100:00080000:3.0:1787836489.455637:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836489.455642:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836489.455648:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787836489.455653:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787836489.455655:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193178880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836489.455660:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193179008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836489.455692:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193178880:12345-0@lo:400:kworker.0 Request processed in 37us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836489.455697:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787836489.455724:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193178752:0@lo:400:kworker.0 00000100:00100000:2.0:1787836489.455742:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193179136:0@lo:400:kworker.0 00000100:00100000:1.0:1787836489.455754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836489.455767:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836489.455777:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193179264:0@lo:400:kworker.0 00000100:00100000:1.0:1787836489.455796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836489.455822:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193178752 00000100:00100000:1.0:1787836489.455825:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193178752 00000100:00100000:1.0:1787836489.455863:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787836489.455868:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3311:x1874682193178752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836489.455901:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3311:x1874682193178752:12345-0@lo:400:kworker.0 Request processed in 33us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836489.455907:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787836489.455933:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193179264 00000100:00100000:1.0:1787836489.455936:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193179264 00000100:00100000:1.0:1787836489.455959:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787836489.455965:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8288b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193179264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836489.455991:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8288b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193179264:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836489.455998:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787836489.456025:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193178752:0@lo:400:kworker.0 00000100:00100000:1.0:1787836489.456036:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193179264:0@lo:400:kworker.0 00000100:00100000:2.0:1787836489.456720:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193179136 00000100:00100000:2.0:1787836489.456728:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193179136 00000100:00100000:2.0:1787836489.456771:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787836489.456778:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193179136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836489.456834:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193179136:12345-0@lo:400:kworker.0 Request processed in 57us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836489.456840:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787836489.456873:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193179136:0@lo:400:kworker.0 00000100:00080000:2.0:1787836489.456915:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787836489.456918:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836489.462771:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193179008:12345-0@lo:400:kworker.0 Request processed in 7102us (7618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836489.462784:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787836489.462922:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193179008:0@lo:400:kworker.0 00000100:00100000:0.0:1787836489.462935:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193178880:0@lo:400:kworker.0 00010000:00010000:1.0:1787836489.902343:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836489.966764:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193179520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836489.966836:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836489.966994:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193179520 00000100:00100000:0.0:1787836489.967002:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193179520 00000100:00100000:0.0:1787836489.967054:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787836489.967086:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c82883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193179520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836489.967125:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836489.967177:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c82883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193179520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836489.967185:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787836489.967455:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604ed00 x1874682193179520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836489.967477:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193179520:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787836490.926615:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836491.503390:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193179648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836491.503484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836491.504009:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193179648 00000100:00100000:0.0:1787836491.504017:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193179648 00000100:00080000:2.0:1787836491.504237:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836491.504279:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787836491.504292:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeace580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193179648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836491.504328:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836491.504404:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeace580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193179648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836491.504410:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787836491.504487:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193179648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787836491.950508:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836492.395358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836492.395412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836492.395450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836492.395489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836492.395524:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172170752 00000100:00100000:3.0:1787836492.395529:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172170624 00000100:00100000:3.0:1787836492.395538:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172170624 00000100:00100000:0.0:1787836492.395538:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172170752 00000100:00100000:1.0:1787836492.395630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172170880 00000100:00100000:1.0:1787836492.395635:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172170880 00000100:00100000:0.0:1787836492.395696:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1787836492.395716:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172170752:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836492.395798:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172170752:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 90us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836492.395810:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1787836492.396004:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172170496 00000100:00100000:0.0:1787836492.396010:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172170496 00000100:00100000:0.0:1787836492.396164:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 284 00000100:00100000:0.0:1787836492.396178:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172170496:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836492.396236:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172170496:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 61us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836492.396245:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 284 00000100:00100000:3.0:1787836492.398520:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:3.0:1787836492.398536:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172170624:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836492.398622:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172170624:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 90us (3170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836492.398630:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00080000:0.0:1787836492.403733:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787836492.403745:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836492.403833:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:1.0:1787836492.403847:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172170880:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836492.403942:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172170880:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 98us (8452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836492.403950:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 123 00010000:00010000:1.0:1787836492.974333:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787836493.806730:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787836494.002708:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836494.574518:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193179904:0@lo:400:kworker.0 00000100:00100000:0.0:1787836494.574595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836494.574716:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193179776:0@lo:400:kworker.0 00000100:00100000:2.0:1787836494.574754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836494.574804:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193179776 00000100:00100000:2.0:1787836494.574811:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193179776 00000100:00100000:2.0:1787836494.574867:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787836494.574877:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3311:x1874682193179776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836494.574928:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3311:x1874682193179776:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836494.574936:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787836494.574988:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193179776:0@lo:400:kworker.0 00000100:00100000:3.0:1787836494.575177:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193179904 00000100:00100000:3.0:1787836494.575182:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193179904 00000100:00100000:3.0:1787836494.575225:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787836494.575233:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193179904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836494.575521:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193180032:0@lo:400:kworker.0 00000100:00100000:2.0:1787836494.575557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836494.575612:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193180032 00000100:00100000:2.0:1787836494.575616:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193180032 00000100:00100000:2.0:1787836494.575668:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787836494.575680:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193180032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836494.575721:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193180032:12345-0@lo:400:kworker.0 Request processed in 47us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836494.575727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787836494.575774:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193180032:0@lo:400:kworker.0 00000100:00080000:2.0:1787836494.575911:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836494.576887:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193179904:12345-0@lo:400:kworker.0 Request processed in 1648us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836494.576899:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787836494.577184:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836494.577197:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c22df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193180416:0@lo:400:kworker.0 00000100:00100000:1.0:1787836494.577276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836494.577320:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193180416 00000100:00100000:1.0:1787836494.577327:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193180416 00000100:00100000:1.0:1787836494.577389:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787836494.577398:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1327c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193180416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836494.577441:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1327c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193180416:12345-0@lo:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836494.577447:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1787836494.577482:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e2c22df0c0 x1874682193180416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836494.577495:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c22df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193180416:0@lo:400:kworker.0 00000100:00080000:1.0:1787836494.577513:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836494.577579:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193180288:0@lo:400:kworker.0 00000100:00100000:2.0:1787836494.577610:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836494.577639:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836494.577655:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193180160:0@lo:400:kworker.0 00000100:00100000:2.0:1787836494.577679:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836494.577706:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193180160 00000100:00100000:2.0:1787836494.577710:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193180160 00000100:00100000:2.0:1787836494.577742:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787836494.577748:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193180160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836494.577784:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193180160:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836494.577790:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787836494.577823:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193180160:0@lo:400:kworker.0 00000100:00100000:1.0:1787836494.578400:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193180288 00000100:00100000:1.0:1787836494.578406:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193180288 00000100:00100000:1.0:1787836494.578451:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787836494.578459:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193180288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836494.578561:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193180288:12345-0@lo:400:kworker.0 Request processed in 102us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836494.578568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1787836494.578586:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787836494.578589:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836494.579018:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193179904:0@lo:400:kworker.0 00000100:00100000:3.0:1787836494.579551:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193180288:0@lo:400:kworker.0 00010000:00010000:0.0:1787836495.022384:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836495.086592:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193180544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836495.086668:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836495.086855:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193180544 00000100:00100000:2.0:1787836495.086864:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193180544 00000100:00100000:2.0:1787836495.086925:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787836495.086935:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1327840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193180544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836495.086970:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836495.087192:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1327840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193180544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 258us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836495.087203:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787836495.089732:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604da40 x1874682193180544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836495.089790:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193180544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836496.047052:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836496.630979:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836496.631011:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193180672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836496.631152:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836496.631203:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193180672 00000100:00100000:0.0:1787836496.631214:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193180672 00000100:00080000:2.0:1787836496.631317:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836496.632558:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787836496.632579:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193180672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836496.632634:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836496.632749:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193180672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836496.632758:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787836496.632842:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193180672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787836497.071844:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836497.518617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836497.518681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836497.518809:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172171008 00000100:00100000:1.0:1787836497.518824:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172171008 00000100:00100000:1.0:1787836497.518906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 286 00000100:00100000:1.0:1787836497.518920:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172171008:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836497.519027:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172171008:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836497.519035:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 286 00000100:00100000:2.0:1787836497.519280:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172171136 00000100:00100000:2.0:1787836497.519286:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172171136 00000100:00100000:2.0:1787836497.519346:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:2.0:1787836497.519386:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172171136:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836497.519440:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172171136:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 57us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836497.519447:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00080000:1.0:1787836497.519817:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836497.538477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836497.538544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836497.538639:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172171392 00000100:00100000:2.0:1787836497.538651:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172171392 00000100:00100000:2.0:1787836497.538746:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:2.0:1787836497.538759:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172171392:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836497.538860:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172171392:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 104us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836497.538868:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00080000:3.0:1787836497.539046:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836497.539262:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172171264 00000100:00100000:1.0:1787836497.539267:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172171264 00000100:00100000:1.0:1787836497.539328:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:1.0:1787836497.539338:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2360:x1874682172171264:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:1.0:1787836497.539375:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7638 00000100:00080000:1.0:1787836497.539387:0:6691:0:(import.c:65:import_set_state_nolock()) ffff98e401cf6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787836497.539439:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787836497.539787:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+2:2360:x1874682172171264:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 450us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836497.539795:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00080000:3.0:1787836497.539919:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787836497.540100:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836498.097819:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836499.118516:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836499.695053:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193180928:0@lo:400:kworker.0 00000100:00100000:2.0:1787836499.695102:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193181184:0@lo:400:kworker.0 00000100:00100000:3.0:1787836499.695186:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193180800:0@lo:400:kworker.0 00000100:00100000:0.0:1787836499.695232:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193181056:0@lo:400:kworker.0 00000100:00100000:2.0:1787836499.700368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836499.700480:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193181184 00000100:00100000:2.0:1787836499.700489:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193181184 00000100:00100000:2.0:1787836499.702892:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787836499.702912:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193181184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836499.703946:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193181184:12345-0@lo:400:kworker.0 Request processed in 1032us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836499.703957:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787836499.704018:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193181184:0@lo:400:kworker.0 00000100:00080000:2.0:1787836499.704071:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836499.704756:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836499.704914:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193181312:0@lo:400:kworker.0 00000100:00100000:3.0:1787836499.704966:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836499.705009:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193181312 00000100:00100000:3.0:1787836499.705015:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193181312 00000100:00100000:3.0:1787836499.705075:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787836499.705084:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193181312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836499.705124:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193181312:12345-0@lo:400:kworker.0 Request processed in 42us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836499.705146:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787836499.705180:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193181312:0@lo:400:kworker.0 00000100:00080000:3.0:1787836499.705360:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836499.705759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193180800 00000100:00100000:2.0:1787836499.705766:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193180800 00000100:00100000:2.0:1787836499.706071:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787836499.706080:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3311:x1874682193180800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836499.706159:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3311:x1874682193180800:12345-0@lo:400:kworker.0 Request processed in 80us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836499.706166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787836499.706847:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193180800:0@lo:400:kworker.0 00000100:00100000:0.0:1787836499.710884:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836499.711012:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836499.711049:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193181440:0@lo:400:kworker.0 00000100:00100000:1.0:1787836499.711110:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836499.711118:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193181056 00000100:00100000:2.0:1787836499.711127:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193181056 00000100:00100000:2.0:1787836499.711781:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193180928 00000100:00100000:2.0:1787836499.711787:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193180928 00000100:00100000:2.0:1787836499.711811:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787836499.711821:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193181056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836499.712032:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787836499.712055:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193180928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836499.712133:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193180928:12345-0@lo:400:kworker.0 Request processed in 81us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836499.712140:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787836499.712289:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193181440 00000100:00100000:3.0:1787836499.712295:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193181440 00000100:00080000:1.0:1787836499.712300:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836499.712347:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787836499.712356:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1324780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193181440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836499.712394:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1324780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193181440:12345-0@lo:400:kworker.0 Request processed in 40us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836499.712400:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787836499.712695:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193181056:12345-0@lo:400:kworker.0 Request processed in 874us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836499.712702:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1787836499.712754:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836499.712763:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193180928:0@lo:400:kworker.0 00010000:00080000:2.0:1787836499.712781:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604da40 x1874682193181440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836499.712791:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193181440:0@lo:400:kworker.0 00000100:00100000:3.0:1787836499.713388:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193181056:0@lo:400:kworker.0 00010000:00010000:1.0:1787836500.142293:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836500.206478:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193181568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836500.206553:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836500.211987:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193181568 00000100:00100000:2.0:1787836500.212008:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193181568 00000100:00100000:2.0:1787836500.212117:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787836500.212129:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1324f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193181568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836500.212177:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836500.217149:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1324f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193181568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5006us (10579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836500.217172:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787836500.221783:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604c3c0 x1874682193181568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836500.221814:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193181568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787836501.167411:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836501.745813:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193181696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836501.745883:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836501.745961:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193181696 00000100:00100000:0.0:1787836501.745969:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193181696 00000100:00100000:0.0:1787836501.746024:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787836501.746034:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193181696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836501.746093:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836501.746141:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193181696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836501.746148:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787836501.746201:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193181696:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787836501.746621:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787836501.846271:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:0.0:1787836501.846279:0:6718:0:(genops.c:885:class_export_put()) final put ffff98e401cf4000/2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:2.0:1787836501.847026:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e401cf4000/2cd520e4-f240-41e5-b585-08ee5ec96478 for lustre-OST0000 00000020:00000080:2.0:1787836501.847102:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e401cf6800 for lustre-OST0000 00010000:00010000:3.0:1787836502.197004:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836502.634053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836502.634141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836502.634178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836502.634468:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172171776 00000100:00100000:2.0:1787836502.634479:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172171776 00000100:00100000:2.0:1787836502.634553:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172171648 00000100:00100000:2.0:1787836502.634556:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172171648 00000100:00100000:2.0:1787836502.634582:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:2.0:1787836502.634593:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172171776:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836502.634680:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172171776:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 88us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836502.634689:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:2.0:1787836502.634709:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:2.0:1787836502.634715:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172171648:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836502.634741:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172171648:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836502.634747:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:0.0:1787836502.635170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172171520 00000100:00100000:0.0:1787836502.635175:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172171520 00000100:00100000:0.0:1787836502.635217:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 288 00000100:00100000:0.0:1787836502.635224:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172171520:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836502.635262:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172171520:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 38us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836502.635268:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 288 00000100:00080000:3.0:1787836502.635522:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787836503.025124:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787836503.214376:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836504.238333:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836504.814496:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193181952:0@lo:400:kworker.0 00000100:00100000:2.0:1787836504.814585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836504.814664:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193182464:0@lo:400:kworker.0 00000100:00100000:2.0:1787836504.814692:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836504.814726:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787836504.814733:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193182080:0@lo:400:kworker.0 00000100:00100000:2.0:1787836504.814756:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836504.814791:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193182464 00000100:00100000:2.0:1787836504.814799:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193182464 00000100:00100000:2.0:1787836504.814858:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787836504.814868:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeace1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193182464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836504.814941:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeace1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193182464:12345-0@lo:400:kworker.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836504.814948:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787836504.814985:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193181952 00000100:00100000:2.0:1787836504.814989:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193181952 00000100:00100000:2.0:1787836504.815014:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193182080 00000100:00100000:2.0:1787836504.815018:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193182080 00000100:00100000:2.0:1787836504.815038:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787836504.815044:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeace940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193181952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836504.815104:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeace940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193181952:12345-0@lo:400:kworker.0 Request processed in 61us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836504.815111:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787836504.815122:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787836504.815128:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193182080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836504.815156:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193182080:12345-0@lo:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836504.815161:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787836504.815206:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193182080:0@lo:400:kworker.0 00000100:00100000:2.0:1787836504.815219:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193181952:0@lo:400:kworker.0 00010000:00080000:2.0:1787836504.815232:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604c780 x1874682193182464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836504.815242:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193182464:0@lo:400:kworker.0 00000100:00100000:1.0:1787836504.815485:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193182208:0@lo:400:kworker.0 00000100:00100000:1.0:1787836504.815517:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836504.815552:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787836504.815558:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193181824:0@lo:400:kworker.0 00000100:00100000:1.0:1787836504.815586:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836504.815610:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193182336:0@lo:400:kworker.0 00000100:00100000:1.0:1787836504.815631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836504.815658:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193182336 00000100:00100000:1.0:1787836504.815662:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193182336 00000100:00100000:1.0:1787836504.815693:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787836504.815709:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1325680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193182336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836504.815748:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1325680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193182336:12345-0@lo:400:kworker.0 Request processed in 40us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836504.815754:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787836504.815777:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193181824 00000100:00100000:1.0:1787836504.815780:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193181824 00000100:00100000:1.0:1787836504.815803:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787836504.815810:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193181824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836504.815839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3310:x1874682193181824:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836504.815845:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787836504.815884:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193181824:0@lo:400:kworker.0 00000100:00100000:1.0:1787836504.815896:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193182336:0@lo:400:kworker.0 00000100:00080000:3.0:1787836504.815992:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836504.815997:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836504.816278:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193182208 00000100:00100000:2.0:1787836504.816283:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193182208 00000100:00100000:2.0:1787836504.816336:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787836504.816351:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1324b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193182208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836504.816401:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1324b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193182208:12345-0@lo:400:kworker.0 Request processed in 51us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836504.816406:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787836504.816518:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836504.816577:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193182208:0@lo:400:kworker.0 00010000:00010000:1.0:1787836505.269994:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836505.327248:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787836505.327272:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193182592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836505.327358:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836505.328256:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193182592 00000100:00100000:0.0:1787836505.328267:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193182592 00000100:00100000:0.0:1787836505.328338:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787836505.328349:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193182592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836505.328388:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836505.328466:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193182592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836505.328473:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787836505.328794:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604f840 x1874682193182592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836505.328814:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193182592:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787836505.939554:0:11857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:15:03 (1787836503) 00010000:00010000:0.0:1787836506.286647:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836506.866929:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787836506.866957:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193182720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836506.867025:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836506.867129:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193182720 00000100:00100000:3.0:1787836506.867138:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193182720 00000100:00100000:3.0:1787836506.867201:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787836506.867213:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193182720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787836506.867253:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836506.867313:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193182720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836506.867341:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1787836506.867367:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836506.867403:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193182720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787836507.313183:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836507.755219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836507.755277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836507.755324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836507.755508:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172171904 00000100:00100000:0.0:1787836507.755521:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172171904 00000100:00100000:0.0:1787836507.755590:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 290 00000100:00100000:0.0:1787836507.755605:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172171904:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836507.755703:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172171904:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 102us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836507.755712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 290 00000100:00100000:1.0:1787836507.757201:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172172160 00000100:00100000:1.0:1787836507.757216:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172172160 00000100:00100000:1.0:1787836507.757613:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172172032 00000100:00100000:1.0:1787836507.757618:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172172032 00000100:00100000:1.0:1787836507.757659:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00100000:1.0:1787836507.757669:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172172160:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836507.757780:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172172160:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 112us (2501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836507.757789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00100000:1.0:1787836507.757810:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:1.0:1787836507.757817:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172172032:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836507.757843:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172172032:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836507.757849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00080000:3.0:1787836507.758083:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836508.002039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836508.002212:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172172288 00000100:00100000:1.0:1787836508.002225:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172172288 00000100:00100000:1.0:1787836508.002311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:1.0:1787836508.002322:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:10247:x1874682172172288:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836508.002362:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836508.002395:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede8e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.002482:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab770a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.002497:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab770a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.002512:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab770a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836508.002751:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787836508.002756:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836508.002873:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab770a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.002903:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede8e expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.002920:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab770a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede8e expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.002928:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431000) 00010000:00010000:1.0:1787836508.002931:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836508.002935:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4000, rc 0) 00000100:00100000:1.0:1787836508.003026:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:10247:x1874682172172288:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 705us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836508.003035:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:1.0:1787836508.024562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836508.025307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172172416 00000100:00100000:0.0:1787836508.025319:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172172416 00000100:00100000:0.0:1787836508.025413:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1787836508.025425:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c13243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:10248:x1874682172172416:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787836508.025450:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836508.025476:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab7711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede95 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.025564:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.025596:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.025609:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.025644:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.025653:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.025660:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026165:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ea00/0x966835ea68ab7726 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026177:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ea00/0x966835ea68ab7726 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026184:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ea00/0x966835ea68ab7726 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836508.026274:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787836508.026290:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836508.026374:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ea00/0x966835ea68ab7726 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026389:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026405:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026412:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026418:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836508.026422:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026428:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026440:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431000) 00010000:00010000:0.0:1787836508.026443:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836508.026448:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026453:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab7718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026466:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026473:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026478:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026483:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ee00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836508.026492:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026498:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026506:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98e3d81a4000) 00010000:00010000:0.0:1787836508.026509:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836508.026512:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026517:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab771f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026554:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab7711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede95 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026567:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ea00/0x966835ea68ab7726 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede95 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836508.026574:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e3d81a4300) 00010000:00010000:0.0:1787836508.026576:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836508.026578:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3ea00, rc 0) 00000100:00100000:0.0:1787836508.026665:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c13243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:10248:x1874682172172416:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1242us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836508.026675:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1787836508.033186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836508.038102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172172672 00000100:00100000:1.0:1787836508.038120:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172172672 00000100:00100000:1.0:1787836508.038260:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:1.0:1787836508.038271:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:10248:x1874682172172672:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836508.038303:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836508.038330:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab772d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ede9c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.038521:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.038536:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.038566:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.038643:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.038652:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.038659:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.039598:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5600/0x966835ea68ab7742 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.039612:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5600/0x966835ea68ab7742 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.039632:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5600/0x966835ea68ab7742 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836508.039643:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787836508.039989:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.039997:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040004:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040009:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836508.040020:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040027:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040042:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e3d81a4300) 00010000:00010000:1.0:1787836508.040045:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836508.040050:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040296:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7734 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040312:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040318:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040324:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040330:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836508.040333:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040338:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040348:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98e3d1431a00) 00010000:00010000:1.0:1787836508.040350:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836508.040369:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.040486:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab773b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.043800:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab772d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede9c expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.043830:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5600/0x966835ea68ab7742 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede9c expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836508.043840:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:1.0:1787836508.043844:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836508.043847:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5600, rc 0) 00000100:00100000:1.0:1787836508.043934:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:10248:x1874682172172672:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 5664us (10759us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787836508.043943:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:3.0:1787836508.054919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836508.055314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172172800 00000100:00100000:0.0:1787836508.055324:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172172800 00000100:00100000:0.0:1787836508.055379:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:0.0:1787836508.055404:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+9:10248:x1874682172172800:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787836508.055521:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+9:10248:x1874682172172800:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 119us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836508.055530:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000040:00080000:3.0:1787836508.145314:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787836508.336984:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836509.358295:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836509.934377:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836509.934408:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c1326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193182976:0@lo:400:kworker.0 00000100:00100000:1.0:1787836509.934494:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836509.934591:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193182976 00000100:00100000:1.0:1787836509.934600:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193182976 00000100:00100000:1.0:1787836509.934657:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787836509.934666:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c13252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193182976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836509.934743:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c13252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193182976:12345-0@lo:400:kworker.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836509.934751:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787836509.934826:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c1326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193182976:0@lo:400:kworker.0 00000100:00100000:1.0:1787836509.934864:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c1326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193183104:0@lo:400:kworker.0 00000100:00100000:1.0:1787836509.934891:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836509.934935:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193183104 00000100:00100000:1.0:1787836509.934939:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193183104 00000100:00100000:3.0:1787836509.935089:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c13261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193182848:0@lo:400:kworker.0 00000100:00100000:3.0:1787836509.935133:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836509.935515:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787836509.935527:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1326d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193183104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836509.935582:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1326d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193183104:12345-0@lo:400:kworker.0 Request processed in 60us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836509.935588:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1787836509.935611:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836509.935637:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c1326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193183104:0@lo:400:kworker.0 00000100:00100000:1.0:1787836509.935651:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836509.935657:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193183488:0@lo:400:kworker.0 00000100:00100000:2.0:1787836509.935666:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193183232:0@lo:400:kworker.0 00000100:00100000:1.0:1787836509.935686:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836509.935731:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836509.935769:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193183488 00000100:00100000:2.0:1787836509.935774:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193183488 00000100:00100000:1.0:1787836509.935810:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193183232 00000100:00100000:1.0:1787836509.935815:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193183232 00000100:00100000:2.0:1787836509.935831:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787836509.935838:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1326940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193183488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836509.935876:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1326940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193183488:12345-0@lo:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836509.935882:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787836509.935895:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787836509.935901:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193183232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836509.935936:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193183232:12345-0@lo:400:kworker.0 Request processed in 36us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836509.935942:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787836509.938697:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787836509.938707:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787836509.938776:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604c3c0 x1874682193183488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787836525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836509.938796:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193183488:0@lo:400:kworker.0 00000100:00100000:0.0:1787836509.941325:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193182848 00000100:00100000:0.0:1787836509.941344:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193182848 00000100:00100000:0.0:1787836509.941416:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787836509.941427:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3311:x1874682193182848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836509.941528:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3311:x1874682193182848:12345-0@lo:400:kworker.0 Request processed in 104us (6394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836509.941536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787836509.952630:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193183232:0@lo:400:kworker.0 00000100:00100000:0.0:1787836509.954322:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c13261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e8e7a0a-4610-42c5-99e6-210da529f97c:3311:1874682193182848:0@lo:400:kworker.0 00000100:00100000:0.0:1787836509.954341:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193183360:0@lo:400:kworker.0 00000100:00100000:0.0:1787836509.954420:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836509.955004:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193183360 00000100:00100000:3.0:1787836509.955012:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193183360 00000100:00080000:0.0:1787836509.955208:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836509.955388:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787836509.955400:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193183360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836509.955486:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874682193183360:12345-0@lo:400:kworker.0 Request processed in 88us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836509.955493:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787836509.955564:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193183360:0@lo:400:kworker.0 00010000:00010000:1.0:1787836510.391609:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836510.446908:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836510.446930:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193183616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836510.447009:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836510.447095:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193183616 00000100:00100000:0.0:1787836510.447102:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193183616 00000100:00100000:0.0:1787836510.447150:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787836510.447159:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193183616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836510.447193:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836510.447240:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193183616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836510.447247:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787836510.447306:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604c000 x1874682193183616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836510.447328:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193183616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836510.459075:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836510.459161:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172172928 00000100:00100000:1.0:1787836510.459175:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172172928 00000100:00080000:0.0:1787836510.459232:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836510.459273:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:1.0:1787836510.459293:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+9:10290:x1874682172172928:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836510.459318:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836510.459344:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edea3 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.459425:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.459450:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.459463:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.459479:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.459487:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.459494:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460046:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460348:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460358:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460364:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836510.460370:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460377:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460393:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431000) 00010000:00010000:1.0:1787836510.460405:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836510.460412:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460418:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460431:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460437:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460442:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460446:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836510.460448:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460454:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460462:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98e3d1431f00) 00010000:00010000:1.0:1787836510.460464:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836510.460468:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460473:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab775e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460511:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7750 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edea3 expref: 10 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460528:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431000) 00010000:00010000:1.0:1787836510.460530:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836510.460534:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edea3 expref: 10 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.460543:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4a00, rc 0) 00000100:00100000:1.0:1787836510.460678:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+9:10290:x1874682172172928:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1394us (1632us total) trans 0 rc 301/301 00000100:00100000:1.0:1787836510.460686:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:2.0:1787836510.479436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836510.479636:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172173184 00000100:00100000:1.0:1787836510.479653:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172173184 00000100:00100000:1.0:1787836510.479741:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:1.0:1787836510.479753:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:10290:x1874682172173184:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:1.0:1787836510.479850:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836510.479887:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab770a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede8e expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.479909:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431000) 00010000:00010000:1.0:1787836510.479922:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836510.480320:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.480338:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.480349:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.480372:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.480379:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.480385:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836510.481361:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787836510.481376:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.481384:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.481393:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.481400:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836510.481405:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.481413:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.481426:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:1.0:1787836510.481429:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836510.481434:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.481452:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7765 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836510.481470:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ee78ee5 reply state 0000000075372f78 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836510.481480:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836510.481624:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+10:10290:x1874682172173184:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 1868us (2200us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787836510.481637:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00010000:00010000:3.0:1787836510.493465:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.493486:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.493495:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.493530:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836510.493537:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.493547:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.493569:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98e3d1431800) 00010000:00010000:3.0:1787836510.493573:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836510.493578:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.493585:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab776c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836510.622042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836510.623011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172173312 00000100:00100000:1.0:1787836510.623029:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172173312 00000100:00100000:1.0:1787836510.623151:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:1.0:1787836510.623163:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+9:10298:x1874682172173312:12345-192.168.203.25@tcp:101:lctl.0 00010000:00010000:1.0:1787836510.623194:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836510.623225:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edeaa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.623320:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab777a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.623336:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab777a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.623350:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab777a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836510.623427:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787836510.623431:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836510.623492:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab777a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.623520:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeaa expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.623538:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab777a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeaa expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.623547:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:1.0:1787836510.623551:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836510.623555:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4000, rc 0) 00000100:00100000:1.0:1787836510.623642:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+10:10298:x1874682172173312:12345-192.168.203.25@tcp:101:lctl.0 Request processed in 481us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836510.623648:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:0.0:1787836510.707945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836510.708045:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172173440 00000100:00100000:1.0:1787836510.708088:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172173440 00000100:00100000:1.0:1787836510.708153:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:1.0:1787836510.708163:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+10:10304:x1874682172173440:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836510.708182:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836510.708201:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edeb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708369:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708384:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708396:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708426:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708433:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708440:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708552:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708560:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.708567:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836510.708599:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787836510.708603:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836510.709450:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709474:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709481:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709489:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709509:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836510.709514:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709522:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709538:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:1.0:1787836510.709541:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836510.709547:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709553:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709572:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709577:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709582:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709587:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836510.709589:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709595:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.709612:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98e3d1431000) 00010000:00010000:1.0:1787836510.709615:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836510.710903:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.710916:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab778f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.711009:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb1 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.711027:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb1 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.711036:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:1.0:1787836510.711039:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787836510.711041:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4800, rc 0) 00000100:00100000:1.0:1787836510.716394:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+11:10304:x1874682172173440:12345-192.168.203.25@tcp:101:bash.0 Request processed in 8212us (8439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836510.716412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:3.0:1787836510.723514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836510.723624:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172173696 00000100:00100000:1.0:1787836510.723636:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172173696 00000100:00100000:1.0:1787836510.723707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:1.0:1787836510.723719:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+11:10304:x1874682172173696:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836510.723745:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836510.723769:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab779d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edeb8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.723950:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.723967:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.723979:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724050:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724104:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724112:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836510.724729:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787836510.724901:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724912:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724921:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724956:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724973:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724980:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.724987:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836510.724992:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.725000:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.725014:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:1.0:1787836510.725018:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836510.725024:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.725030:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab77a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836510.725043:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041040097 reply state 00000000d7e6bf5a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836510.725051:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787836510.725140:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab779d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.725155:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.725173:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d1431600) 00010000:00010000:1.0:1787836510.725176:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836510.725179:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4200, rc 0) 00000100:00100000:1.0:1787836510.725282:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10304:x1874682172173696:12345-192.168.203.25@tcp:101:bash.0 Request processed in 1565us (1780us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787836510.725290:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00010000:00010000:2.0:1787836510.727243:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.727292:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.727300:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.727305:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836510.727310:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.727319:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.727335:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d1431000) 00010000:00010000:2.0:1787836510.727338:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836510.727343:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.727349:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab77ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836510.728750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836510.733951:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172173824 00000100:00100000:2.0:1787836510.733977:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172173824 00000100:00100000:2.0:1787836510.734050:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:2.0:1787836510.734087:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874682172173824:12345-192.168.203.25@tcp:8:bash.0 00010000:00080000:2.0:1787836510.734133:0:6692:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:2.0:1787836510.734175:0:6692:0:(genops.c:1385:class_connect()) connect: client 2cd520e4-f240-41e5-b585-08ee5ec96478, cookie 0x966835ea68ab77c0 00002000:00100000:2.0:1787836510.734191:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2cd520e4-f240-41e5-b585-08ee5ec96478/ffff98e401d43800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787836510.734221:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1787836510.734477:0:6692:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787836510.734510:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98e401d41800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787836510.734600:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2360:x1874682172173824:12345-192.168.203.25@tcp:8:bash.0 Request processed in 540us (5858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836510.734609:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1787836510.742014:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836510.742228:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172173952 00000100:00100000:0.0:1787836510.742238:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172173952 00000100:00100000:0.0:1787836510.742331:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1787836510.742344:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:0:x1874682172173952:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1787836510.742367:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836510.742394:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edebf expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787836510.742428:0:10087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836510.742454:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1787836510.742460:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836510.742494:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 7 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836510.742532:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 7 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836510.742548:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3e000, rc 0) 00000100:00100000:0.0:1787836510.742615:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:0:x1874682172173952:12345-192.168.203.25@tcp:101:bash.0 Request processed in 275us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836510.742623:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00080000:1.0:1787836510.742698:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836510.747740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836510.747853:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172174080 00000100:00100000:2.0:1787836510.747865:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172174080 00000100:00100000:2.0:1787836510.747939:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1787836510.747951:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:10304:x1874682172174080:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836510.747976:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836510.748004:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edec6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.748043:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 8 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.748053:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836510.748102:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836510.748110:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.748158:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 8 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.748174:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 8 pid: 10087 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836510.748207:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a60780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1874682193183744:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836510.748316:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3eebf9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787836510.756025:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a60780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1874682193183744:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836510.756128:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.756157:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005aa00, rc 0) 00000100:00100000:2.0:1787836510.756240:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:10304:x1874682172174080:12345-192.168.203.25@tcp:101:bash.0 Request processed in 8291us (8513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836510.756252:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:0.0:1787836510.758048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836510.758750:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172174208 00000100:00100000:3.0:1787836510.758762:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172174208 00010000:00010000:3.0:1787836510.758831:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 8 pid: 10087 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836510.758883:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:3.0:1787836510.758896:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2361:x1874682172174208:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836510.758913:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836510.758939:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 8 pid: 10087 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.758972:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 8 pid: 10087 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.759002:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab77c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edebf expref: 8 pid: 10087 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.759023:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836510.759028:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836510.759039:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.759050:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836510.759145:0:7631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836510.759161:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7631:1874682193183872:192.168.203.25@tcp:105: 00000100:00100000:3.0:1787836510.759268:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e951ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836510.767748:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9ad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7631:1874682193183872:192.168.203.25@tcp:105: 00010000:00010000:2.0:1787836510.767793:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836510.772202:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2361:x1874682172174208:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 13289us (14146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836510.772223:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:2.0:1787836510.781245:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836510.781416:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172174464 00000100:00100000:3.0:1787836510.781425:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172174464 00000100:00100000:2.0:1787836510.781593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1787836510.781605:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+13:10304:x1874682172174464:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:2.0:1787836510.782280:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10304:x1874682172174464:12345-192.168.203.25@tcp:35:bash.0 Request processed in 674us (1047us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787836510.782288:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:1.0:1787836510.898184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836510.898459:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172174720 00000100:00100000:2.0:1787836510.898489:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172174720 00000100:00100000:2.0:1787836510.898559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:2.0:1787836510.898571:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1325a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10314:x1874682172174720:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836510.898605:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836510.898644:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab77d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edecd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836510.899026:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787836510.899235:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab77d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edecd expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.899253:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:2.0:1787836510.899266:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836510.899274:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab77d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edecd expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836510.899292:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836510.899386:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1325a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+15:10314:x1874682172174720:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 818us (1214us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787836510.899395:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:0.0:1787836510.905711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836510.905813:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172174976 00000100:00100000:3.0:1787836510.905941:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172174976 00000100:00100000:3.0:1787836510.906047:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1787836510.906083:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+15:10314:x1874682172174976:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836510.906493:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+16:10314:x1874682172174976:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 433us (792us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787836510.906502:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1787836510.993664:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836510.993876:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172175104 00000100:00100000:1.0:1787836510.993887:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172175104 00000100:00100000:1.0:1787836510.993971:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:1.0:1787836510.993983:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+16:10320:x1874682172175104:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836510.994221:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836510.994410:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab77e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000eded4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.994489:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab77ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.994504:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab77ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.994517:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab77ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836510.994682:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787836510.994703:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836510.994734:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab77ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.994764:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab77e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eded4 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.994785:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab77ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eded4 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836510.994795:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:1.0:1787836510.994898:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836510.994902:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5e00, rc 0) 00000100:00100000:1.0:1787836510.994981:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+17:10320:x1874682172175104:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1000us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836510.994990:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:1.0:1787836510.999775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836510.999912:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172175360 00000100:00100000:2.0:1787836510.999924:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172175360 00000100:00100000:2.0:1787836511.000146:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:2.0:1787836511.000158:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c13270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+17:10320:x1874682172175360:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836511.000182:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836511.000205:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab77f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ededb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.000356:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab77f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.000370:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab77f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.000384:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab77f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836511.000396:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787836511.000536:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab77f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ededb expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.000555:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab77f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ededb expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.000564:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d1431600) 00010000:00010000:2.0:1787836511.000567:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836511.000570:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005bc00, rc 0) 00000100:00100000:2.0:1787836511.000654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c13270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+19:10320:x1874682172175360:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 499us (894us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787836511.000662:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:0.0:1787836511.004705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836511.004798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.004881:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172175488 00000100:00100000:2.0:1787836511.004894:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172175488 00000100:00100000:2.0:1787836511.004961:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:2.0:1787836511.004971:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:2362:x1874682172175488:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836511.004990:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836511.005030:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab77f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ededb expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.005051:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d1431600) 00010000:00010000:2.0:1787836511.005091:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836511.005146:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2362:x1874682172175488:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 177us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836511.005154:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:1.0:1787836511.007766:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172175744 00000100:00100000:1.0:1787836511.007787:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172175744 00000100:00100000:1.0:1787836511.008023:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:1.0:1787836511.008036:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+18:10320:x1874682172175744:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836511.008079:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836511.008103:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edee2 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.008344:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab780d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.008361:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab780d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.008390:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab780d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836511.008445:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787836511.008602:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edee2 expref: 21 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.008708:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab780d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edee2 expref: 20 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.008719:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d1431600) 00010000:00010000:1.0:1787836511.008722:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787836511.008725:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5a00, rc 0) 00000100:00100000:1.0:1787836511.008814:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+20:10320:x1874682172175744:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 781us (4120us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787836511.008823:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:0.0:1787836511.015179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836511.015314:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172175872 00000100:00100000:1.0:1787836511.015330:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172175872 00000100:00100000:1.0:1787836511.015517:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1787836511.015530:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172175872:12345-192.168.203.25@tcp:1:lfs.0 00010000:00010000:1.0:1787836511.015602:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.015635:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.015646:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836511.015662:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787836511.015668:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.015714:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.015730:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836511.015748:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c1326580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1874682193184000:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836511.015886:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ef7d30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836511.019151:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c1326580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1874682193184000:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836511.019190:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836511.019652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836511.019933:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172176000 00000100:00100000:3.0:1787836511.019942:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172176000 00002000:00100000:3.0:1787836511.020006:0:6696:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff98e401d4b480 x1874682172176000/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:297/0 lens 504/0 e 0 to 0 dl 1787836522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787836511.020019:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401d4b480 with x1874682172176000 ext(0->12) 00010000:00010000:3.0:1787836511.020029:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 8 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.020044:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 8 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836511.020051:0:6696:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e401d4b480 00000100:00100000:3.0:1787836511.020126:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:3.0:1787836511.020137:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2363:x1874682172176000:12345-192.168.203.25@tcp:4:lfs.0 00000001:00100000:1.0:1787836511.058521:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000001:00080000:1.0:1787836511.090930:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1787836511.091586:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172176000:12345-192.168.203.25@tcp:4:lfs.0 Request processed in 71443us (71928us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787836511.091606:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00002000:00100000:2.0:1787836511.091704:0:6696:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff98e401d4b480 x1874682172176000/t4294967299(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:297/0 lens 504/448 e 0 to 0 dl 1787836522 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836511.091718:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401d4b480 with x1874682172176000 ext(0->12) 00010000:00010000:2.0:1787836511.091734:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.091759:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787836511.091768:0:6696:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e401d4b480 00000100:00100000:0.0:1787836511.095158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.095342:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172176128 00000100:00100000:2.0:1787836511.095353:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172176128 00010000:00010000:2.0:1787836511.095397:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836511.095473:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:2.0:1787836511.095499:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172176128:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836511.095517:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787836511.095539:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787836511.095542:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787836509 00002000:00010000:2.0:1787836511.095545:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787836510 00002000:00010000:2.0:1787836511.095546:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787836509 00002000:00010000:2.0:1787836511.095548:0:5828:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787836511.095554:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.095582:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.095610:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ae58b1/0x966835ea68ab77ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edec6 expref: 7 pid: 6692 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.095699:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836511.095704:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836511.095710:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.095721:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.095806:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836511.095866:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172176128:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 369us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836511.095885:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00010000:00010000:0.0:1787836511.097434:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.097456:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.097495:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.097504:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.097528:0:10087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.097535:0:10087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5800 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836511.097540:0:10087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.097548:0:10087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.097567:0:10087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.097575:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028cab2e1/0x966835ea68ab781b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836511.098244:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172175872:12345-192.168.203.25@tcp:1:lfs.0 Request processed in 82708us (83184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836511.098267:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1787836511.101717:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.102274:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172176384 00000100:00100000:2.0:1787836511.102287:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172176384 00000100:00100000:2.0:1787836511.102407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1787836511.102420:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+20:10320:x1874682172176384:12345-192.168.203.25@tcp:35:lfs.0 00000004:00010000:2.0:1787836511.102505:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab780d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edee2 expref: 20 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787836511.103172:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787836511.103243:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787836511.104458:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787836511.104543:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.104566:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.104576:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.104708:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.104730:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 24 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836511.104747:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874682193184128:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836511.105164:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3eebf9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787836511.108433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836511.108494:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172176512 00000100:00100000:3.0:1787836511.108503:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172176512 00010000:00010000:3.0:1787836511.108542:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 25 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836511.108580:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:3.0:1787836511.108590:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+25:2364:x1874682172176512:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836511.108633:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836511.108641:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 25 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.108655:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 25 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.108679:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d1431600) 00010000:00010000:3.0:1787836511.108684:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.108693:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.108700:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.108717:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836511.108767:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+25:2364:x1874682172176512:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 179us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836511.108774:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00010000:00010000:2.0:1787836511.110289:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab77b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb8 expref: 24 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836511.110314:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874682193184128:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836511.110338:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.110347:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.110353:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787836511.110507:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787836511.110746:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787836511.110924:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193184256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787836511.110998:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836511.111657:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3eebf9900 going to sleep for 11 seconds 00000100:00100000:0.0:1787836511.111870:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193184256 00000100:00100000:0.0:1787836511.111879:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193184256 00000100:00100000:0.0:1787836511.111992:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836511.112003:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874682193184256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787836511.112143:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874682193184256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836511.112150:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787836511.112268:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193184256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787836511.113269:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787836511.113369:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193184384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787836511.113421:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836511.113449:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836511.113596:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193184384 00000100:00100000:2.0:1787836511.113603:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193184384 00000100:00100000:2.0:1787836511.113659:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787836511.113668:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874682193184384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787836511.114129:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1874682193184384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 460us (705us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787836511.114137:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836511.114479:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193184384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787836511.114564:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787836511.114608:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787836511.114774:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787836511.114829:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.114838:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.114845:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836511.114850:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.114859:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.114878:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d1431600) 00010000:00010000:3.0:1787836511.114882:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787836511.114888:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.114894:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7822 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787836511.115157:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787836511.115419:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787836511.115433:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359548373358ns, next at 360548370312ns, rc = 0 00000001:00080000:3.0:1787836511.115441:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787836511.115484:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d1431600) 00010000:00010000:3.0:1787836511.115487:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787836511.115507:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab780d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edee2 expref: 28 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836511.115662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10320:x1874682172176384:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 13243us (13958us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787836511.115673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000020:00080000:3.0:1787836511.115679:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787836511.118416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.118524:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172176640 00000100:00100000:2.0:1787836511.118536:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172176640 00000100:00100000:2.0:1787836511.118602:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:2.0:1787836511.118613:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10320:x1874682172176640:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836511.118663:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836511.118689:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7829 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edee9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.118764:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7829 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edee9 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.118783:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7829 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edee9 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.118956:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836511.118961:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787836511.118965:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005aa00, rc 0) 00000100:00100000:2.0:1787836511.119055:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+28:10320:x1874682172176640:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 444us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836511.119094:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1787836511.122635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.122794:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172176896 00000100:00100000:2.0:1787836511.122815:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172176896 00000100:00100000:2.0:1787836511.122882:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1787836511.122894:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93ce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+28:10320:x1874682172176896:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1787836511.123265:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93ce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10320:x1874682172176896:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 362us (641us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787836511.123275:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:3.0:1787836511.229434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.229546:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172177152 00000100:00100000:2.0:1787836511.229556:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172177152 00000100:00100000:2.0:1787836511.229641:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:2.0:1787836511.229652:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10330:x1874682172177152:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836511.229693:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836511.229715:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edef0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836511.229849:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787836511.229978:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7830 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef0 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.229994:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:2.0:1787836511.229997:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836511.230002:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef0 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.230016:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836511.230132:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10330:x1874682172177152:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 483us (708us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787836511.230139:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:1.0:1787836511.236218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.236324:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172177280 00000100:00100000:2.0:1787836511.236336:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172177280 00000100:00100000:2.0:1787836511.236395:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:2.0:1787836511.236406:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10330:x1874682172177280:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:2.0:1787836511.236487:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236503:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236514:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236546:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236554:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236560:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236676:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236685:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236692:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836511.236731:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236743:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236750:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236758:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236764:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836511.236768:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236782:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236805:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836511.236809:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836511.236815:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236822:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab783e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236836:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236843:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236848:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236853:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836511.236856:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236862:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236868:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3c2410500) 00010000:00010000:2.0:1787836511.236871:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836511.236874:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236890:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7845 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236905:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236911:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236917:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236922:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836511.236925:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236932:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236939:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836511.236941:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836511.236944:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.236949:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab784c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836511.237030:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1326580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10330:x1874682172177280:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 625us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836511.237037:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:0.0:1787836511.240437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.240563:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172177536 00000100:00100000:2.0:1787836511.240583:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172177536 00000100:00100000:2.0:1787836511.240659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1787836511.240671:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10330:x1874682172177536:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1787836511.241016:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10330:x1874682172177536:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 338us (578us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787836511.241024:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:0.0:1787836511.281516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.281629:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172177792 00000100:00100000:2.0:1787836511.281640:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172177792 00000100:00100000:2.0:1787836511.281716:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:2.0:1787836511.281726:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10333:x1874682172177792:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836511.281753:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836511.281778:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edef7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.281907:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.281923:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.281934:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.281948:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.281956:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.281974:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282149:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282158:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282165:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836511.282175:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787836511.282299:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282307:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282313:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282319:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836511.282323:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282330:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282342:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836511.282345:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836511.282357:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282363:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab785a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282375:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282381:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282387:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282392:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836511.282395:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282399:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282407:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3c2410500) 00010000:00010000:2.0:1787836511.282410:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836511.282412:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282418:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282464:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282490:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.282497:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836511.282500:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836511.282503:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a800, rc 0) 00000100:00100000:2.0:1787836511.282581:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10333:x1874682172177792:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 857us (1079us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787836511.282590:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:1.0:1787836511.286896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.287094:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172177920 00000100:00100000:2.0:1787836511.287106:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172177920 00000100:00100000:2.0:1787836511.287181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:2.0:1787836511.287192:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c13261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10333:x1874682172177920:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:2.0:1787836511.287303:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287327:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287346:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287380:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287388:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287417:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287423:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005ae00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836511.287428:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287437:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287453:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836511.287457:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836511.287462:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.287469:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836511.287563:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c13261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10333:x1874682172177920:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 373us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836511.287571:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:0.0:1787836511.290901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.291043:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172178176 00000100:00100000:2.0:1787836511.291056:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172178176 00000100:00100000:2.0:1787836511.291142:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:2.0:1787836511.291152:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10333:x1874682172178176:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1787836511.291427:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+34:10333:x1874682172178176:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 276us (535us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787836511.291436:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00010000:00010000:1.0:1787836511.406370:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787836511.547743:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000001:00080000:2.0:1787836511.547773:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:2.0:1787836511.547819:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787836511.547845:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e3e7d40240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787836511.547850:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3f5eda000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e3e7d40d80 00000020:00080000:2.0:1787836511.547854:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3f5eda200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e3f5af5800 00000020:00080000:3.0:1787836511.548045:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787836511.548209:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787836511.548460:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193184512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787836511.548552:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836511.548727:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193184512 00000100:00100000:1.0:1787836511.548737:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193184512 00000100:00100000:1.0:1787836511.548812:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787836511.548823:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193184512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787836511.548859:0:6691:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787836511.548907:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a90385d, atime: 0x6a90385e, ctime: 0x6a90385d, blocks: 0xb 00010000:00010000:1.0:1787836511.548918:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.548942:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1787836511.548948:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836511.548957:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.548978:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.548990:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.548998:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836511.549027:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787836511.549649:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193184512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 825us (1094us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787836511.549659:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1787836511.549737:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e3eeaced00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787836511.549744:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193184512:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787836511.549839:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836511.549847:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.549856:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836511.549861:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.549871:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.549889:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.549896:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006623cbc3/0x966835ea68ab787d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.549930:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836511.549931:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836511.549933:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836511.578176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.578290:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172178432 00000100:00100000:2.0:1787836511.578300:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172178432 00000100:00100000:2.0:1787836511.578357:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:2.0:1787836511.578367:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+12:10365:x1874682172178432:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:2.0:1787836511.578392:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836511.578410:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edefe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.578517:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab788b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.578532:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab788b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.578546:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab788b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836511.578558:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787836511.578856:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edefe expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.578890:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab788b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edefe expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.578899:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836511.578902:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836511.578906:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005bc00, rc 0) 00000100:00100000:2.0:1787836511.578984:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10365:x1874682172178432:12345-192.168.203.25@tcp:101:cat.0 Request processed in 618us (819us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787836511.578992:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:1.0:1787836511.584470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836511.584574:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172178560 00000100:00100000:0.0:1787836511.584587:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172178560 00000100:00100000:0.0:1787836511.584668:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1787836511.584681:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+14:2362:x1874682172178560:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836511.584705:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836511.584738:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab788b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edefe expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836511.584764:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:0.0:1787836511.584771:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836511.584852:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+13:2362:x1874682172178560:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 172us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836511.584862:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1787836511.585806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.585890:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172178816 00000100:00100000:2.0:1787836511.585897:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172178816 00000100:00100000:2.0:1787836511.585944:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:2.0:1787836511.585953:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:10365:x1874682172178816:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:2.0:1787836511.586574:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10365:x1874682172178816:12345-192.168.203.25@tcp:35:cat.0 Request processed in 618us (769us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787836511.586585:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:3.0:1787836511.665553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.665699:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172179072 00000100:00100000:2.0:1787836511.665710:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172179072 00000100:00100000:2.0:1787836511.665832:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:2.0:1787836511.665846:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10371:x1874682172179072:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:2.0:1787836511.665875:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836511.665878:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787836511.665906:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab77ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eded4 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.665948:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836511.665953:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836511.665969:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7899 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf05 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.666143:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.666157:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.666165:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.666197:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.666208:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 14 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836511.666220:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193184640:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836511.666315:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c1254c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836511.668814:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193184640:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836511.668852:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836511.670031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.670875:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172179200 00000100:00100000:2.0:1787836511.670904:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172179200 00010000:00010000:2.0:1787836511.670954:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 15 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836511.670997:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:2.0:1787836511.671014:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+15:2364:x1874682172179200:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836511.671035:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836511.671043:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 15 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.671079:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 15 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.671105:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edef7 expref: 15 pid: 5841 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.671123:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836511.671128:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.671138:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.671223:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.671260:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836511.671369:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.671377:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836511.671394:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787836511.671587:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7899 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.671602:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.671617:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:3.0:1787836511.671619:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787836511.671623:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836511.671770:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+15:2364:x1874682172179200:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 761us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836511.671792:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:3.0:1787836511.673490:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10371:x1874682172179072:12345-192.168.203.25@tcp:101:dd.0 Request processed in 7633us (7998us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787836511.673503:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:1.0:1787836511.675853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836511.676144:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172179456 00000100:00100000:2.0:1787836511.676154:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172179456 00000100:00100000:2.0:1787836511.676229:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:2.0:1787836511.676239:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10371:x1874682172179456:12345-192.168.203.25@tcp:36:dd.0 00010000:00010000:2.0:1787836511.676523:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.676541:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836511.676553:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787836511.676602:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787836511.676761:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3bcb2ae reply state 00000000d60023a9 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836511.676771:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787836511.676874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+17:10371:x1874682172179456:12345-192.168.203.25@tcp:36:dd.0 Request processed in 636us (1030us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787836511.676882:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000020:00080000:2.0:1787836511.676887:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787836511.684087:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.684117:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.684155:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.684163:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836511.684171:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.684184:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.684211:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:3.0:1787836511.684216:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836511.684222:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836511.684231:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab78ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836511.985000:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836511.985023:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193184768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836511.985146:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836511.985230:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193184768 00000100:00100000:1.0:1787836511.985237:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193184768 00000100:00100000:1.0:1787836511.985300:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787836511.985308:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193184768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787836511.985341:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836511.985392:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193184768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836511.985410:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787836511.985434:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836511.985473:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c1d8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193184768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836512.009822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836512.009941:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172179584 00000100:00100000:2.0:1787836512.009953:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172179584 00000100:00100000:2.0:1787836512.010044:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:2.0:1787836512.010087:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+16:10385:x1874682172179584:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:2.0:1787836512.010118:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836512.010158:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab78b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf0c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010232:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010247:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010269:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010285:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010292:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010298:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010659:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010672:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010680:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010712:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.010741:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 17 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836512.010755:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193184896:192.168.203.25@tcp:104: 00000100:00080000:1.0:1787836512.011471:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836512.012078:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c1254c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836512.017012:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193184896:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836512.017044:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836512.018161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836512.021908:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172179840 00000100:00100000:3.0:1787836512.021928:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172179840 00000100:00100000:3.0:1787836512.022126:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1787836512.022139:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:5599:x1874682172179840:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787836512.022627:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:5599:x1874682172179840:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 488us (4469us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787836512.022637:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1787836512.029234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836512.029420:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172179968 00000100:00100000:2.0:1787836512.029435:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172179968 00010000:00010000:2.0:1787836512.029498:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 19 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836512.029550:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1787836512.029561:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:2364:x1874682172179968:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836512.029593:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836512.029600:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 19 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.029615:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 19 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.029645:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab78a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf05 expref: 19 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.029703:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836512.029709:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.029720:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.029730:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.029777:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836512.029863:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2364:x1874682172179968:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 303us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836512.029873:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00010000:00010000:1.0:1787836512.030236:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030247:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836512.030411:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787836512.030417:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836512.030523:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030547:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030558:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030565:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030573:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030592:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836512.030596:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030605:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030620:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:1.0:1787836512.030623:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836512.030628:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030635:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab78bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030649:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030655:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030667:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030673:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836512.030676:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030682:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030690:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d8034000) 00010000:00010000:1.0:1787836512.030693:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836512.030695:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030702:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab78c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030837:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab78b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf0c expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030855:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf0c expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.030861:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:1.0:1787836512.030864:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836512.030867:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:1.0:1787836512.030960:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+17:10385:x1874682172179584:12345-192.168.203.25@tcp:101:stat.0 Request processed in 20907us (21150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836512.030977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1787836512.147474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836512.147633:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172180224 00000100:00100000:1.0:1787836512.147644:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172180224 00000100:00100000:1.0:1787836512.147717:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1787836512.147727:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+17:10391:x1874682172180224:12345-192.168.203.25@tcp:36:truncate.0 00010000:00010000:1.0:1787836512.147792:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836512.147820:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab78ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf0c expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.147856:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:1.0:1787836512.147861:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836512.151418:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.151453:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.151470:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836512.151639:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787836512.151713:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d38e3a6a reply state 00000000722bbdee transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836512.151724:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836512.151872:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+19:10391:x1874682172180224:12345-192.168.203.25@tcp:36:truncate.0 Request processed in 4142us (4407us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787836512.151882:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00000020:00080000:1.0:1787836512.151903:0:10086:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787836512.158096:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.158116:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.158138:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.158144:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836512.158149:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.158157:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.158173:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:3.0:1787836512.158176:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836512.158181:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.158188:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab78d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836512.370183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836512.370325:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172180352 00000100:00100000:3.0:1787836512.370336:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172180352 00000100:00100000:3.0:1787836512.370400:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:3.0:1787836512.370411:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+18:10405:x1874682172180352:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:3.0:1787836512.370433:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836512.370472:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab78d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf13 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.370534:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.370549:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.370574:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.370589:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.370597:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.370604:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376541:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376563:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376577:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836512.376625:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787836512.376629:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836512.376656:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376670:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376681:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376700:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376707:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376713:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836512.376718:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376830:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.376995:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:3.0:1787836512.376999:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836512.377007:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377013:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab78df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377030:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377036:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377042:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377048:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836512.377131:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377138:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377148:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d224a300) 00010000:00010000:3.0:1787836512.377151:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836512.377155:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377161:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab78e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.377394:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab78d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.378604:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.378619:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:3.0:1787836512.378622:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836512.378626:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13acc00, rc 0) 00000100:00100000:3.0:1787836512.379148:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+19:10405:x1874682172180352:12345-192.168.203.25@tcp:101:stat.0 Request processed in 8735us (8972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836512.379159:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00010000:00010000:1.0:1787836512.430439:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836512.522540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836512.522663:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172180608 00000100:00100000:1.0:1787836512.522684:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172180608 00000100:00100000:1.0:1787836512.522758:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1787836512.522769:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:10415:x1874682172180608:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836512.522791:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836512.522811:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab78f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf1a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836512.523344:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787836512.523530:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab78f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf1a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.523545:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:1.0:1787836512.523549:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836512.523554:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab78f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf1a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.523567:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4e00, rc 0) 00000100:00100000:1.0:1787836512.523642:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+20:10415:x1874682172180608:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 875us (1110us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787836512.523651:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:2.0:1787836512.527589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836512.527711:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172180864 00000100:00100000:3.0:1787836512.527723:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172180864 00000100:00100000:3.0:1787836512.527905:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:3.0:1787836512.527920:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+20:10415:x1874682172180864:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836512.528465:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10415:x1874682172180864:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 547us (886us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787836512.528474:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:3.0:1787836512.620115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836512.620327:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172181120 00000100:00100000:1.0:1787836512.620341:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172181120 00000100:00100000:1.0:1787836512.620418:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:1.0:1787836512.620430:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10421:x1874682172181120:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836512.620462:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836512.620519:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7902 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf21 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.620649:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.620669:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.620680:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.620733:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.620747:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 22 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836512.620765:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5ee83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193185024:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836512.620914:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787836512.629643:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836512.629753:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172181248 00000100:00100000:3.0:1787836512.629764:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172181248 00010000:00010000:3.0:1787836512.629816:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 23 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836512.629861:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:3.0:1787836512.629871:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+23:2363:x1874682172181248:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836512.629899:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836512.629907:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 23 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.629922:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 23 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.630026:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:3.0:1787836512.630033:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.630045:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.630055:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.630139:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836512.630204:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+23:2363:x1874682172181248:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 333us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836512.630213:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00010000:00010000:1.0:1787836512.631599:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab78ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf13 expref: 22 pid: 5843 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836512.631626:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5ee83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193185024:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836512.631649:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.631659:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.631696:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836512.631720:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787836512.632207:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7902 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.632224:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.632234:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:1.0:1787836512.632237:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787836512.632241:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4a00, rc 0) 00000100:00100000:1.0:1787836512.634827:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+22:10421:x1874682172181120:12345-192.168.203.25@tcp:101:bash.0 Request processed in 14386us (14758us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787836512.634840:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:0.0:1787836512.645853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836512.645974:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172181504 00000100:00100000:1.0:1787836512.645988:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172181504 00000100:00100000:1.0:1787836512.646099:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:1.0:1787836512.646110:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+22:10421:x1874682172181504:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:1.0:1787836512.646473:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.646497:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.646513:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836512.646602:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787836512.646638:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f0531c reply state 00000000db4938d6 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836512.646648:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836512.646783:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+25:10421:x1874682172181504:12345-192.168.203.25@tcp:36:bash.0 Request processed in 674us (940us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787836512.646791:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000020:00080000:1.0:1787836512.646798:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787836512.664564:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.664586:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.664594:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.664600:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836512.664606:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.664624:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.664648:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:3.0:1787836512.664651:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836512.664657:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836512.664663:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836512.665301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836512.667478:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172181632 00000100:00100000:3.0:1787836512.667497:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172181632 00000100:00100000:3.0:1787836512.667591:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:3.0:1787836512.667601:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+24:10421:x1874682172181632:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836512.667638:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836512.667660:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab791e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf28 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.668112:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.668133:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.668143:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.668182:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.668200:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 25 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836512.668217:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5ee83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193185152:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836512.668506:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836512.677365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836512.677454:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172181760 00000100:00100000:0.0:1787836512.677466:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172181760 00000100:00100000:1.0:1787836512.677503:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5ee83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193185152:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836512.677520:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 26 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.677534:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836512.677662:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:0.0:1787836512.677683:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+26:2364:x1874682172181760:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836512.677701:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836512.677709:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 26 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.677723:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 26 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.677761:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7909 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf21 expref: 26 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.677780:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:0.0:1787836512.677786:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.677796:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.677806:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.678323:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.678335:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836512.678401:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787836512.678407:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836512.678438:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.678501:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab791e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf28 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.678519:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf28 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.678527:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:1.0:1787836512.678530:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836512.678533:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5000, rc 0) 00000100:00100000:1.0:1787836512.678636:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+25:10421:x1874682172181632:12345-192.168.203.25@tcp:101:bash.0 Request processed in 11035us (13341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836512.678645:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00010000:00010000:0.0:1787836512.679130:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836512.679167:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+24:2364:x1874682172181760:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1494us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836512.679176:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:2.0:1787836512.683822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836512.685845:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172182016 00000100:00100000:3.0:1787836512.685859:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172182016 00000100:00100000:2.0:1787836512.686505:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:2.0:1787836512.686517:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93cf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+24:10421:x1874682172182016:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:2.0:1787836512.686779:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93cf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+25:10421:x1874682172182016:12345-192.168.203.25@tcp:35:bash.0 Request processed in 264us (2971us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787836512.686787:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1787836512.793001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836512.793111:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172182272 00000100:00100000:1.0:1787836512.793120:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172182272 00000100:00100000:1.0:1787836512.793184:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1787836512.793194:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+25:10431:x1874682172182272:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836512.793218:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836512.793265:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab792c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf2f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836512.793822:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787836512.794025:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab792c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf2f expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.794043:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:1.0:1787836512.794046:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836512.794052:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab792c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf2f expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.794096:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5e00, rc 0) 00000100:00100000:1.0:1787836512.794184:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+26:10431:x1874682172182272:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 991us (1190us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787836512.794192:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:0.0:1787836512.797653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836512.797868:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172182400 00000100:00100000:1.0:1787836512.797878:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172182400 00000100:00100000:1.0:1787836512.797940:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:1.0:1787836512.797951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+26:10431:x1874682172182400:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:1.0:1787836512.798077:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798110:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798138:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798146:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798153:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798533:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798544:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798551:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836512.798591:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798605:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798611:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798618:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798624:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836512.798628:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798643:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798656:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:1.0:1787836512.798659:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836512.798663:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798668:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab793a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798680:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798686:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798691:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798696:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836512.798699:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798704:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798712:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d1431d00) 00010000:00010000:1.0:1787836512.798714:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836512.798717:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798733:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798749:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798755:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798761:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798765:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836512.798768:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798773:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798781:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:1.0:1787836512.798854:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836512.798859:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.798865:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836512.798968:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+26:10431:x1874682172182400:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 1015us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836512.798978:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:2.0:1787836512.802147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836512.802625:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172182656 00000100:00100000:3.0:1787836512.802635:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172182656 00000100:00100000:3.0:1787836512.802693:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1787836512.802705:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+26:10431:x1874682172182656:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836512.803192:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10431:x1874682172182656:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 489us (1053us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787836512.803201:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1787836512.837845:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836512.837979:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172182912 00000100:00100000:0.0:1787836512.837988:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172182912 00000100:00100000:0.0:1787836512.838040:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1787836512.838050:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10434:x1874682172182912:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836512.838098:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836512.838117:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab794f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf36 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838187:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838200:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838211:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838224:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838230:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838236:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838610:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838621:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838640:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836512.838651:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787836512.838740:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838748:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838754:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838760:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3fe00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836512.838764:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838772:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838796:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:0.0:1787836512.838799:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836512.838804:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838810:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838823:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838829:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838841:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838847:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836512.838850:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838857:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.838865:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d81a4f00) 00010000:00010000:0.0:1787836512.838867:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836512.839457:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.839468:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab795d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.839529:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab794f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf36 expref: 30 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.839544:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf36 expref: 29 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836512.839552:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:0.0:1787836512.839555:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836512.839558:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3ee00, rc 0) 00000100:00100000:0.0:1787836512.839628:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10434:x1874682172182912:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1579us (1791us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787836512.839649:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1787836512.842534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836512.842624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836512.843105:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172183168 00000100:00100000:2.0:1787836512.843115:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172183168 00000100:00100000:2.0:1787836512.843198:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:2.0:1787836512.843208:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+29:2363:x1874682172183168:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836512.843224:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836512.843259:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf36 expref: 29 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836512.843279:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836512.843284:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836512.843502:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+28:2363:x1874682172183168:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 294us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836512.843511:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1787836512.843707:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172183040 00000100:00100000:1.0:1787836512.843712:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172183040 00000100:00100000:1.0:1787836512.843911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:1.0:1787836512.843920:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+28:10434:x1874682172183040:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:1.0:1787836512.843978:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.843992:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.844003:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.844031:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.844038:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.844045:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.844052:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836512.844076:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.844084:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.844093:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:1.0:1787836512.844096:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836512.844100:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836512.844118:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836512.844162:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+28:10434:x1874682172183040:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 243us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836512.844168:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:3.0:1787836512.847575:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836512.847677:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172183424 00000100:00100000:2.0:1787836512.847686:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172183424 00000100:00100000:2.0:1787836512.847754:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:2.0:1787836512.847765:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+28:10434:x1874682172183424:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1787836512.848042:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10434:x1874682172183424:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 277us (485us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787836512.848049:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:0.0:1787836512.915864:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836512.915900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836512.915933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836512.916049:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172183552 00000100:00100000:3.0:1787836512.916078:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172183552 00000100:00100000:3.0:1787836512.916132:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 292 00000100:00100000:3.0:1787836512.916140:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172183552:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836512.916202:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172183552:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836512.916209:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 292 00000100:00100000:2.0:1787836512.916543:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172183680 00000100:00100000:2.0:1787836512.916548:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172183680 00000100:00100000:2.0:1787836512.916598:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:2.0:1787836512.916604:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172183680:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836512.916637:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172183680:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 33us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836512.916643:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00080000:3.0:1787836512.917164:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836512.917597:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172183808 00000100:00100000:1.0:1787836512.917977:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172183808 00000100:00100000:1.0:1787836512.918093:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 142 00000100:00100000:1.0:1787836512.918104:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172183808:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836512.918174:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172183808:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 73us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836512.918180:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 142 00000100:00080000:3.0:1787836512.918773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836513.060670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.060919:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172184064 00000100:00100000:1.0:1787836513.060931:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172184064 00000100:00100000:1.0:1787836513.061000:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:1.0:1787836513.061010:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10452:x1874682172184064:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:1.0:1787836513.061051:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836513.061516:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.061653:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7980 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.061671:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.061685:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836513.061699:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787836513.061891:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf3d expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.061912:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf3d expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.061921:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:0.0:1787836513.061924:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787836513.061928:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3e800, rc 0) 00000100:00100000:0.0:1787836513.062008:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10452:x1874682172184064:12345-192.168.203.25@tcp:101:cat.0 Request processed in 998us (1349us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787836513.062030:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:0.0:1787836513.105000:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.111376:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172184192 00000100:00100000:1.0:1787836513.111528:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172184192 00000100:00100000:1.0:1787836513.111728:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:1.0:1787836513.111747:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10453:x1874682172184192:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836513.111785:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836513.111816:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab798e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf44 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.111967:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.111981:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.111992:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836513.112229:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787836513.112233:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836513.112312:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.112352:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab798e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf44 expref: 33 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.112368:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf44 expref: 32 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.112376:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:1.0:1787836513.112379:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836513.112382:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4200, rc 0) 00000100:00100000:1.0:1787836513.112467:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10453:x1874682172184192:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 723us (7480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836513.112475:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:3.0:1787836513.124757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.125564:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172184576 00000100:00100000:2.0:1787836513.125589:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172184576 00000100:00100000:2.0:1787836513.125668:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:2.0:1787836513.125681:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10453:x1874682172184576:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1787836513.126880:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10453:x1874682172184576:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 1097us (2034us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787836513.126893:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1787836513.135546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.135865:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172184704 00000100:00100000:2.0:1787836513.135888:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172184704 00000100:00100000:2.0:1787836513.135991:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:2.0:1787836513.136005:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10453:x1874682172184704:12345-192.168.203.25@tcp:103:lfs.0 00010000:00010000:2.0:1787836513.136026:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787836513.136105:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf28 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.136137:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf3d expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.136153:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7829 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edee9 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.136164:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3c2410000) 00010000:00010000:2.0:1787836513.136188:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836513.136273:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10453:x1874682172184704:12345-192.168.203.25@tcp:103:lfs.0 Request processed in 270us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.136282:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1787836513.143564:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.143777:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172184832 00000100:00100000:2.0:1787836513.143989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172184832 00000100:00100000:2.0:1787836513.144546:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:2.0:1787836513.144558:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10453:x1874682172184832:12345-192.168.203.25@tcp:58:lfs.0 00010000:00010000:2.0:1787836513.144776:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.144807:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.144820:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836513.147296:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787836513.147764:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787836513.148236:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787836513.148411:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10453:x1874682172184832:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 3849us (4855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.148424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:3.0:1787836513.176295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.176417:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172184960 00000100:00100000:2.0:1787836513.176428:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172184960 00000100:00100000:2.0:1787836513.176498:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:2.0:1787836513.176510:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10455:x1874682172184960:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836513.176533:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836513.176553:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab79a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf4b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.176765:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.176781:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.176879:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.176900:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.176908:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.176914:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177418:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177429:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177437:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836513.177539:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787836513.177543:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836513.177564:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177576:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177583:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177600:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177681:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177690:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836513.177697:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177705:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177720:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836513.177723:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836513.177731:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177738:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab79aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177752:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177757:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177762:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177768:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836513.177778:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177860:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177869:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d8034900) 00010000:00010000:2.0:1787836513.177872:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836513.177875:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177881:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab79b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177925:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab79a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177940:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.177947:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034700) 00010000:00010000:2.0:1787836513.177949:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836513.177951:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a800, rc 0) 00000100:00100000:3.0:1787836513.178370:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10455:x1874682172184960:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1858us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836513.178381:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00000040:00080000:1.0:1787836513.262385:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836513.262399:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836513.262497:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787836513.262509:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787836513.262755:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5ee83c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193185280:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787836513.263438:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50180 going to sleep for 11 seconds 00000100:00100000:3.0:1787836513.275726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.275870:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5ee83c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193185280:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787836513.276950:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172185088 00000100:00100000:0.0:1787836513.276960:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172185088 00000100:00100000:0.0:1787836513.277026:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:0.0:1787836513.277037:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10466:x1874682172185088:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787836513.277178:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10466:x1874682172185088:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 Request processed in 143us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836513.277186:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1787836513.280456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836513.283639:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172185216 00000100:00100000:0.0:1787836513.283656:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172185216 00000100:00100000:0.0:1787836513.284524:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:0.0:1787836513.284542:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10466:x1874682172185216:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787836513.284584:0:5842:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787836513.284743:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10466:x1874682172185216:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 208us (4300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836513.284750:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:1.0:1787836513.300911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836513.302619:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172185344 00000100:00100000:0.0:1787836513.302633:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172185344 00000100:00100000:0.0:1787836513.302698:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:0.0:1787836513.302709:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10466:x1874682172185344:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787836513.302779:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.302818:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.302830:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.302847:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.302854:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.302861:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303139:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303149:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303156:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836513.303194:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787836513.303198:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836513.303210:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303222:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303253:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303261:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303267:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ee00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836513.303272:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303279:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303292:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:0.0:1787836513.303295:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836513.303300:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303306:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab79bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303320:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303326:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303331:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303336:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836513.303345:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303352:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303360:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff98e3d81a4f00) 00010000:00010000:0.0:1787836513.303362:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836513.303365:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303370:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab79c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303386:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303391:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303396:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303401:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836513.303403:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303408:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303415:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034700) 00010000:00010000:0.0:1787836513.303417:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836513.303426:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.303432:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab79cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836513.303645:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10466:x1874682172185344:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 936us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836513.303655:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:3.0:1787836513.317170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.326747:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172185600 00000100:00100000:1.0:1787836513.326770:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172185600 00000100:00100000:1.0:1787836513.326863:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:1.0:1787836513.326886:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10466:x1874682172185600:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836513.326912:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836513.326938:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab79d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf52 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327050:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327084:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327097:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836513.327111:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787836513.327229:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327237:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327268:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327275:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836513.327281:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327289:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327316:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034700) 00010000:00010000:1.0:1787836513.327320:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836513.327325:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327332:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327380:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab79d4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf52 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327391:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:1.0:1787836513.327394:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836513.327398:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab79d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf52 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.327407:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5800, rc 0) 00000100:00100000:1.0:1787836513.328745:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10466:x1874682172185600:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1863us (11575us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787836513.328768:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:3.0:1787836513.339859:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.340011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172185728 00000100:00100000:1.0:1787836513.340022:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172185728 00000100:00100000:1.0:1787836513.340110:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:1.0:1787836513.340120:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10466:x1874682172185728:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787836513.340158:0:5841:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787836513.340285:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10466:x1874682172185728:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 166us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836513.340294:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1787836513.355652:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.365261:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172185984 00000100:00100000:1.0:1787836513.365276:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172185984 00000100:00100000:1.0:1787836513.365361:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:1.0:1787836513.365382:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c82892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10466:x1874682172185984:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836513.365407:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836513.365411:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787836513.365441:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf44 expref: 32 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.365476:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:1.0:1787836513.365481:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836513.365495:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab79e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf59 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836513.366723:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787836513.368238:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.368291:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.368307:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.369447:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab79e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf59 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.369537:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf59 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.369546:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836513.369549:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836513.369553:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5e00, rc 0) 00000100:00100000:1.0:1787836513.369640:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c82892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10466:x1874682172185984:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 4259us (13996us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787836513.369649:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:3.0:1787836513.373799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.373903:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172186240 00000100:00100000:1.0:1787836513.373917:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172186240 00000100:00100000:1.0:1787836513.373987:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:1.0:1787836513.373997:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10466:x1874682172186240:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787836513.374083:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836513.374115:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab79f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf59 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.374138:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836513.374168:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836513.374197:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.374215:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.374226:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.374254:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.374262:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.374269:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383323:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383344:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383353:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383359:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836513.383363:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383373:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383393:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:0.0:1787836513.383396:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836513.383402:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383407:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab79fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383434:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383439:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383445:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383463:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836513.383467:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383473:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383481:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe14e64b0 (ffff98e3d1431400) 00010000:00010000:0.0:1787836513.383484:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836513.383487:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.383493:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7a05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe14e64b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836513.383620:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10466:x1874682172186240:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 9617us (9830us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787836513.383631:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:3.0:1787836513.393508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836513.393604:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172186368 00000100:00100000:0.0:1787836513.393615:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172186368 00000100:00100000:0.0:1787836513.393677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:0.0:1787836513.393696:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10466:x1874682172186368:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787836513.393720:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836513.393749:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7a0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf60 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.393804:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.393818:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.393831:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.393926:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.393945:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.393958:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:0.0:1787836513.393961:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787836513.393965:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3e200, rc 0) 00000100:00100000:0.0:1787836513.394028:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10466:x1874682172186368:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 334us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836513.394035:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:3.0:1787836513.398843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836513.400153:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172186624 00000100:00100000:0.0:1787836513.400172:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172186624 00000100:00100000:0.0:1787836513.400260:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:0.0:1787836513.400288:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10466:x1874682172186624:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787836513.400398:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.400419:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.400432:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787836513.402299:0:10086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787836513.402333:0:10086:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361835274093ns, next at 362835266052ns, rc = 0 00000004:00010000:0.0:1787836513.402505:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a383f4e reply state 00000000f7fb02a3 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836513.402520:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787836513.402687:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+35:10466:x1874682172186624:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 2396us (3851us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787836513.402706:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:0.0:1787836513.412318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.412418:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172186752 00000100:00100000:2.0:1787836513.412432:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172186752 00000100:00100000:2.0:1787836513.412511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:2.0:1787836513.412524:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+35:10466:x1874682172186752:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836513.412558:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836513.412582:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf67 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.412683:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.412702:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.412727:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:2.0:1787836513.412731:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787836513.412736:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836513.412819:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+36:10466:x1874682172186752:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 298us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.412828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 76 00010000:00010000:3.0:1787836513.413170:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.413179:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.413186:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.413192:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836513.413198:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.413205:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.413221:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:3.0:1787836513.413231:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787836513.413236:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.413253:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab7a1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.418595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836513.418726:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172186880 00000100:00100000:0.0:1787836513.418739:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172186880 00000100:00100000:0.0:1787836513.418810:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1787836513.418820:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874682172186880:12345-192.168.203.25@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787836513.418859:0:6691:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:0.0:1787836513.418906:0:6691:0:(genops.c:1385:class_connect()) connect: client 2cd520e4-f240-41e5-b585-08ee5ec96478, cookie 0x966835ea68ab7a28 00002000:00100000:0.0:1787836513.418918:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2cd520e4-f240-41e5-b585-08ee5ec96478/ffff98e3c404d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787836513.418949:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:0.0:1787836513.419275:0:6691:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787836513.419314:0:6691:0:(import.c:65:import_set_state_nolock()) ffff98e3c4049800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787836513.419395:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2360:x1874682172186880:12345-192.168.203.25@tcp:8:lhsmtool_posix.0 Request processed in 575us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836513.419404:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:3.0:1787836513.425720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.426026:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172187008 00000100:00100000:2.0:1787836513.426041:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172187008 00000100:00100000:2.0:1787836513.426153:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:2.0:1787836513.426166:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:0:x1874682172187008:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787836513.426701:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787836513.459147:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787836513.498288:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000001:00080000:1.0:1787836513.498318:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1787836513.498455:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:0:x1874682172187008:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 72286us (72739us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787836513.498467:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:1.0:1787836513.508470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.515331:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172187264 00000100:00100000:2.0:1787836513.515349:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172187264 00000100:00100000:2.0:1787836513.515502:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836513.515514:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+35:10466:x1874682172187264:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787836513.515814:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+36:10466:x1874682172187264:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 301us (7351us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787836513.515823:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:1.0:1787836513.524664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.524746:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172187520 00000100:00100000:2.0:1787836513.524767:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172187520 00000100:00100000:2.0:1787836513.524841:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:2.0:1787836513.524852:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+36:10466:x1874682172187520:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787836513.524973:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+36:10466:x1874682172187520:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 123us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.524981:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:3.0:1787836513.529915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.530004:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172187648 00000100:00100000:2.0:1787836513.530014:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172187648 00000100:00100000:2.0:1787836513.530104:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:2.0:1787836513.530116:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+36:10466:x1874682172187648:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836513.530139:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836513.530159:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf6e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.530233:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.530256:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.530267:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836513.530306:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836513.530327:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.530355:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf6e expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.530394:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf6e expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.530402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:2.0:1787836513.530405:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787836513.530409:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a000, rc 0) 00000100:00100000:2.0:1787836513.530469:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+37:10466:x1874682172187648:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 356us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.530477:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:1.0:1787836513.533771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836513.533823:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172187776 00000100:00100000:0.0:1787836513.533834:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172187776 00000100:00100000:0.0:1787836513.533897:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:0.0:1787836513.533908:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172187776:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787836513.533929:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836513.533954:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf75 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787836513.533984:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a903860, blocks: 0x1 00010000:00010000:0.0:1787836513.534009:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1787836513.534014:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836513.534025:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.534047:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.534109:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3e400, rc 0) 00000100:00100000:0.0:1787836513.534182:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2363:x1874682172187776:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 276us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836513.534203:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:1.0:1787836513.537157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.537308:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172188032 00000100:00100000:2.0:1787836513.537318:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172188032 00000100:00100000:2.0:1787836513.537380:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:2.0:1787836513.537390:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+37:10466:x1874682172188032:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787836513.537516:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+37:10466:x1874682172188032:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 126us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.537524:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:3.0:1787836513.543484:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.543618:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172188160 00000100:00100000:2.0:1787836513.543633:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172188160 00000100:00100000:2.0:1787836513.543700:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:2.0:1787836513.543711:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:10466:x1874682172188160:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836513.543729:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836513.543750:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf7c expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.543784:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.543816:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836513.543821:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836513.543827:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 7 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.543891:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.543907:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 7 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836513.543925:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193185408:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836513.544053:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5657540 going to sleep for 11 seconds 00000100:00100000:3.0:1787836513.547384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.547610:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193185408:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836513.547655:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 7 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.547685:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005be00, rc 0) 00000100:00100000:2.0:1787836513.547752:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:10466:x1874682172188160:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 4043us (4281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.547762:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:0.0:1787836513.548850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172188288 00000100:00100000:0.0:1787836513.548863:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172188288 00010000:00010000:0.0:1787836513.548907:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 7 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836513.548961:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:0.0:1787836513.548972:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8602850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172188288:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836513.548990:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836513.549019:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 7 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.549036:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 7 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.549116:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009830869b/0x966835ea68ab7a3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf75 expref: 7 pid: 6691 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.549132:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836513.549136:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836513.549144:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 6 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.549156:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 6 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.549225:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 6 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836513.549246:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1874682193185536:192.168.203.25@tcp:105: 00000100:00100000:0.0:1787836513.549336:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787836513.552521:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1874682193185536:192.168.203.25@tcp:105: 00010000:00010000:0.0:1787836513.552555:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836513.552657:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8602850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172188288:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 3684us (5282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836513.552675:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:3.0:1787836513.556661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.556889:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172188416 00000100:00100000:2.0:1787836513.556900:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172188416 00002000:00100000:2.0:1787836513.556952:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98e3f5cac3c0 x1874682172188416/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:299/0 lens 504/0 e 0 to 0 dl 1787836524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836513.556983:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3f5cac3c0 with x1874682172188416 ext(0->8) 00002000:00010000:2.0:1787836513.556988:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e3f5cac3c0 00000100:00100000:2.0:1787836513.557025:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:2.0:1787836513.557035:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172188416:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787836513.557842:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172188416:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 Request processed in 805us (1187us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787836513.557852:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00002000:00100000:2.0:1787836513.557860:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98e3f5cac3c0 x1874682172188416/t4294967302(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:299/0 lens 504/448 e 0 to 0 dl 1787836524 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836513.557870:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3f5cac3c0 with x1874682172188416 ext(0->8) 00002000:00010000:2.0:1787836513.557874:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e3f5cac3c0 00000100:00100000:3.0:1787836513.561172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836513.561305:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172188544 00000100:00100000:0.0:1787836513.561317:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172188544 00000100:00100000:0.0:1787836513.561389:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:0.0:1787836513.561400:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+37:10466:x1874682172188544:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787836513.678149:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1787836513.678162:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787836513.678199:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1787836513.678225:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1787836513.678388:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787836513.678418:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193185664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787836513.678512:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836513.678581:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193185664 00000100:00100000:2.0:1787836513.678588:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193185664 00000100:00100000:2.0:1787836513.678650:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787836513.678660:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193185664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787836513.678841:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787836513.678845:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787836512 00002000:00010000:2.0:1787836513.678864:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787836513.678866:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787836512 -> 1787836512 00002000:00010000:2.0:1787836513.678868:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787836513.678920:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193185664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 260us (407us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787836513.678928:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787836513.678984:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e401fd6580/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787836513.678990:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193185664:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787836513.679251:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787836513.679262:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787836513.679749:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:10466:x1874682172188544:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 118348us (118586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836513.679758:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00080000:0.0:1787836513.679799:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836513.686542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836513.687288:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172188672 00000100:00100000:3.0:1787836513.687300:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172188672 00000100:00100000:3.0:1787836513.687367:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:3.0:1787836513.687377:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172188672:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787836513.758527:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1787836513.758563:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1787836513.758948:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172188672:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 71562us (72404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836513.758965:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:0.0:1787836513.769259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836513.769809:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172188928 00000100:00100000:3.0:1787836513.769821:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172188928 00000100:00100000:3.0:1787836513.769907:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:3.0:1787836513.769920:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+13:10466:x1874682172188928:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787836513.769990:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836513.770044:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf6e expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.770085:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:3.0:1787836513.770091:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836513.770125:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.770138:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.770148:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787836513.770453:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9ade294 reply state 0000000093c8a68a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.770465:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787836513.770584:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10466:x1874682172188928:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 666us (1344us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787836513.770591:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:0.0:1787836513.781226:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.781909:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172189056 00000100:00100000:2.0:1787836513.781921:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172189056 00000100:00100000:2.0:1787836513.782041:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:2.0:1787836513.782053:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2363:x1874682172189056:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787836513.782383:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787836513.782399:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787836512 -> 1787836511 00002000:00010000:2.0:1787836513.782402:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787836510 00002000:00010000:2.0:1787836513.782404:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787836512 -> 1787836511 00002000:00010000:2.0:1787836513.782407:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787836513.782495:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172189056:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 443us (1280us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787836513.782502:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00010000:00010000:3.0:1787836513.783126:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.783138:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.783146:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.783153:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836513.783158:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.783189:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.783209:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:3.0:1787836513.783212:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836513.783218:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.783225:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.799894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.800145:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172189312 00000100:00100000:1.0:1787836513.800159:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172189312 00000100:00100000:1.0:1787836513.800235:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:1.0:1787836513.800255:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+13:10466:x1874682172189312:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787836513.800336:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.800355:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.800365:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.800420:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.800437:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 13 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836513.800454:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5ee9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193185792:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836513.800572:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787836513.806539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836513.808120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172189440 00000100:00100000:3.0:1787836513.808141:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172189440 00010000:00010000:3.0:1787836513.808198:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 14 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.808333:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:3.0:1787836513.808345:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+14:2364:x1874682172189440:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836513.808367:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836513.808375:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 14 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.808401:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 14 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.808429:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:3.0:1787836513.808436:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.808460:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.808468:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.808493:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836513.808557:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+14:2364:x1874682172189440:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 215us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836513.808566:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00010000:00010000:2.0:1787836513.810591:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab7a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf60 expref: 13 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836513.810620:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5ee9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193185792:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836513.810649:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810793:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810802:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810845:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810851:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810859:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810865:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836513.810869:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810877:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:0.0:1787836513.810897:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787836513.810902:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.810907:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7a52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836513.810991:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+12:10466:x1874682172189312:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 Request processed in 10736us (11112us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787836513.811000:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:1.0:1787836513.820256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.820475:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172189568 00000100:00100000:2.0:1787836513.820487:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172189568 00000100:00100000:2.0:1787836513.820561:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:2.0:1787836513.820574:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2362:x1874682172189568:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787836513.820632:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.820655:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 7 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.820666:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787836513.820671:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836513.820676:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.820716:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 7 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.820734:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 7 pid: 10087 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836513.820752:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193185920:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836513.820938:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787836513.824250:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836513.824298:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172189696 00000100:00100000:3.0:1787836513.824310:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172189696 00000100:00100000:2.0:1787836513.824346:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193185920:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836513.824356:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 8 pid: 10087 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.824382:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.824419:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:3.0:1787836513.824432:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cacf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172189696:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836513.824451:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836513.824479:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 8 pid: 10087 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824493:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 8 pid: 10087 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824528:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab7a44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf7c expref: 8 pid: 10087 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824558:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836513.824563:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836513.824568:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824579:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824763:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836513.824829:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cacf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172189696:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 399us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836513.824839:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00010000:00010000:3.0:1787836513.824870:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824878:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824900:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824908:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824915:0:10087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824930:0:10087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836513.824934:0:10087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824943:0:10087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824954:0:10087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.824962:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007075e052/0x966835ea68ab7a59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.825006:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172189568:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 4436us (4773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836513.825013:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:2.0:1787836513.838684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836513.838821:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172189952 00000100:00100000:3.0:1787836513.838833:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172189952 00000100:00100000:3.0:1787836513.838910:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:3.0:1787836513.838921:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+12:10466:x1874682172189952:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787836513.839023:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.839044:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.839126:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.839550:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.839564:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.839573:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.839689:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.839703:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 13 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.839719:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cad680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874682193186048:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836513.839854:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3eebf9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787836513.856658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836513.856696:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172190080 00000100:00100000:1.0:1787836513.856707:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172190080 00010000:00010000:1.0:1787836513.856754:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 14 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836513.856816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:1.0:1787836513.856828:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+14:2363:x1874682172190080:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836513.856846:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836513.856853:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 14 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.856867:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 14 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.856894:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:1.0:1787836513.856900:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.856910:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.856918:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836513.856938:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836513.857004:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+14:2363:x1874682172190080:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 177us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836513.857013:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00010000:00010000:0.0:1787836513.858928:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf67 expref: 13 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836513.858970:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cad680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874682193186048:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836513.859010:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.859022:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.859029:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787836513.859392:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787836513.859553:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787836513.859598:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787836513.859683:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1874682193186176:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787836513.859750:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836513.860932:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193186176 00000100:00100000:2.0:1787836513.860945:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193186176 00000100:00100000:2.0:1787836513.861015:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787836513.861027:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1874682193186176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787836513.861203:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1874682193186176:12345-0@lo:1000:mdt00_000.0 Request processed in 178us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.861210:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787836513.861384:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e973d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836513.861410:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787836513.861416:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e401fd6580, transno 4294967303 00000100:00100000:0.0:1787836513.861441:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1874682193186176:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787836513.863438:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787836513.863532:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1874682193186304:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787836513.863600:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836513.863634:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981540 going to sleep for 11 seconds 00000100:00100000:2.0:1787836513.863764:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193186304 00000100:00100000:2.0:1787836513.863773:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193186304 00000100:00100000:2.0:1787836513.863913:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836513.863924:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1874682193186304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787836513.864169:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1874682193186304:12345-0@lo:1000:mdt00_000.0 Request processed in 246us (567us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787836513.864176:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787836513.864336:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1874682193186304:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787836513.864374:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864400:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864407:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864413:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836513.864418:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864426:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864443:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:0.0:1787836513.864446:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787836513.864451:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864457:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7a67 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864493:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864498:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864504:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864509:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005aa00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836513.864518:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864525:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864534:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034700) 00010000:00010000:0.0:1787836513.864537:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787836513.864540:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864546:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab799c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864568:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864582:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864591:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864621:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836513.864634:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 16 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836513.864645:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874682193186432:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836513.864719:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981540 going to sleep for 11 seconds 00000100:00100000:1.0:1787836513.869162:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.869250:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172190208 00000100:00100000:2.0:1787836513.869259:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172190208 00010000:00010000:2.0:1787836513.869306:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 17 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836513.869352:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:2.0:1787836513.869363:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+17:2364:x1874682172190208:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836513.869377:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836513.869384:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 17 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.869418:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 17 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.869443:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034700) 00010000:00010000:2.0:1787836513.869449:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.869459:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.869468:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.869488:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836513.869541:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+17:2364:x1874682172190208:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 180us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836513.869549:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00010000:00010000:3.0:1787836513.870040:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab79b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf4b expref: 16 pid: 5841 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.870078:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874682193186432:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836513.870098:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870107:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870121:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870132:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870138:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870145:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870152:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836513.870156:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870163:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870173:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034700) 00010000:00010000:3.0:1787836513.870175:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836513.870179:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870185:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7a6e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870195:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870200:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870210:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870215:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836513.870218:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870224:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870231:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034700) 00010000:00010000:3.0:1787836513.870232:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787836513.870235:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836513.870251:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7a60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836513.870519:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+15:10466:x1874682172189952:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 31599us (31842us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1787836513.870528:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00000020:00080000:3.0:1787836513.870533:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787836513.870696:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836513.870701:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836513.870728:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787836513.870744:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787836513.874762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836513.874869:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172190464 00000100:00100000:2.0:1787836513.874883:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172190464 00000100:00100000:2.0:1787836513.874967:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:2.0:1787836513.874979:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+15:10466:x1874682172190464:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787836513.875850:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787836513.876013:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787836513.876102:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876121:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876146:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876156:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876162:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876169:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876200:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787836513.876329:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+17:10466:x1874682172190464:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 1349us (1580us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787836513.876340:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000020:00080000:2.0:1787836513.876347:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787836513.876386:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836513.876392:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876400:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836513.876404:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876414:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876427:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98e3d8034900) 00010000:00010000:2.0:1787836513.876430:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787836513.876443:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876449:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7a75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836513.876470:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836513.876471:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836513.876473:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787836514.190378:0:12008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787836514.190389:0:12008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787836514.190466:0:12008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787836514.190474:0:12008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787836514.323743:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836514.331824:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172190720 00000100:00100000:0.0:1787836514.331843:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172190720 00000100:00100000:0.0:1787836514.331932:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:0.0:1787836514.331943:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+17:10476:x1874682172190720:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836514.331969:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836514.331990:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf83 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787836514.332283:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787836514.332607:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fa00/0x966835ea68ab7a83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.332628:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fa00/0x966835ea68ab7a83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.332642:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fa00/0x966835ea68ab7a83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836514.332656:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787836514.332850:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf83 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.332869:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fa00/0x966835ea68ab7a83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf83 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.332879:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:0.0:1787836514.332881:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787836514.332884:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3fa00, rc 0) 00000100:00100000:0.0:1787836514.332966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+19:10476:x1874682172190720:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1025us (9232us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787836514.332984:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:3.0:1787836514.342704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836514.342765:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172190848 00000100:00100000:0.0:1787836514.342777:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172190848 00000100:00100000:0.0:1787836514.342935:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 85 00000100:00100000:0.0:1787836514.343019:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+19:10476:x1874682172190848:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1787836514.343198:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.343217:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.343229:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.343363:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.343373:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.346854:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.348927:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349324:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349339:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836514.349632:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349652:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349660:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349668:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349675:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3fc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836514.349680:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349687:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349702:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:1.0:1787836514.349706:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836514.349718:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349724:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349736:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349742:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349748:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349754:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836514.349758:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349764:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349772:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d81a4f00) 00010000:00010000:1.0:1787836514.349775:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836514.349778:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349783:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349799:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349815:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349820:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349825:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836514.349828:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349834:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349842:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836514.349844:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836514.349847:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.349853:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab7a9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836514.350162:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+19:10476:x1874682172190848:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 7212us (7461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836514.350174:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 85 00000100:00100000:3.0:1787836514.427325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836514.427371:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172191104 00000100:00100000:3.0:1787836514.427381:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172191104 00000100:00100000:3.0:1787836514.427448:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 86 00000100:00100000:3.0:1787836514.427459:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+19:10479:x1874682172191104:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836514.427480:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836514.427514:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf8a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.427596:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.427611:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.427623:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.427638:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.427645:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.427652:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428105:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428115:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428123:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836514.428133:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787836514.428270:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428287:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428293:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428299:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836514.428304:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428311:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428322:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:3.0:1787836514.428325:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836514.428330:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428336:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7aad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428350:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428356:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428362:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428366:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ace00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836514.428376:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428383:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428392:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d224a600) 00010000:00010000:3.0:1787836514.428394:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836514.428397:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428403:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428448:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428463:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.428470:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:3.0:1787836514.428472:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836514.428474:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad800, rc 0) 00000100:00100000:3.0:1787836514.428549:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10479:x1874682172191104:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1091us (1243us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787836514.428558:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 86 00000100:00100000:0.0:1787836514.444835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836514.444872:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172191232 00000100:00100000:0.0:1787836514.444882:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172191232 00000100:00100000:0.0:1787836514.444944:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:0.0:1787836514.444955:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10479:x1874682172191232:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1787836514.448608:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448632:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448645:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448672:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448679:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448686:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448692:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836514.448696:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448703:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448713:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:0.0:1787836514.448716:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787836514.448720:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.448726:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836514.448805:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10479:x1874682172191232:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 3848us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836514.448819:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:3.0:1787836514.455008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836514.455104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172191488 00000100:00100000:3.0:1787836514.455115:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172191488 00000100:00100000:3.0:1787836514.455164:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:3.0:1787836514.455190:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93cc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10479:x1874682172191488:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836514.455519:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93cc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+22:10479:x1874682172191488:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 332us (522us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787836514.455532:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00010000:00010000:1.0:1787836514.479309:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836514.508220:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836514.508308:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172191744 00000100:00100000:3.0:1787836514.508318:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172191744 00000100:00100000:3.0:1787836514.508384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:3.0:1787836514.508395:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+22:10005:x1874682172191744:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836514.508427:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836514.508454:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7ad0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf91 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.508588:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.510107:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.510120:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.511031:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.511081:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 23 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836514.511101:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193186560:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836514.511241:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3eebf9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787836514.526869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836514.527031:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b683c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193186560:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836514.527092:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836514.532360:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172191872 00000100:00100000:3.0:1787836514.532379:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172191872 00010000:00010000:2.0:1787836514.532619:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 24 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836514.532668:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:2.0:1787836514.532696:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+24:2363:x1874682172191872:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836514.532713:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836514.532722:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 24 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.532735:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 24 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.532758:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf8a expref: 24 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.532855:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:2.0:1787836514.532861:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.532872:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.532880:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.532912:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836514.532977:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+23:2363:x1874682172191872:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 282us (6119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836514.532985:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00010000:00010000:3.0:1787836514.533923:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.533939:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836514.534727:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787836514.534952:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7ad0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.534981:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.534992:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:3.0:1787836514.534994:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787836514.534999:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ace00, rc 0) 00000100:00100000:3.0:1787836514.535116:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+23:10005:x1874682172191744:12345-192.168.203.25@tcp:101:bash.0 Request processed in 26723us (26906us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787836514.535125:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:1.0:1787836514.538767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836514.539117:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172192128 00000100:00100000:2.0:1787836514.539128:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172192128 00000100:00100000:2.0:1787836514.539187:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 89 00000100:00100000:2.0:1787836514.539318:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+23:10005:x1874682172192128:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:2.0:1787836514.539600:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.539618:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.539630:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787836514.539680:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787836514.539701:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073a33e7a reply state 0000000033682a2b transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836514.539710:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787836514.539749:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787836514.539862:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10005:x1874682172192128:12345-192.168.203.25@tcp:36:bash.0 Request processed in 546us (1104us total) trans 4294967369 rc 0/0 00010000:00010000:1.0:1787836514.544252:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.544289:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.544297:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.544303:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836514.544308:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.544316:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.544334:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:1.0:1787836514.544337:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836514.544342:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.544348:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7ae5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836514.544747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836514.544817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172192256 00000100:00100000:3.0:1787836514.544826:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172192256 00000100:00100000:2.0:1787836514.546340:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 89 00000020:00080000:2.0:1787836514.546350:0:10086:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787836514.551509:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:3.0:1787836514.551536:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+26:10005:x1874682172192256:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836514.551562:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836514.551584:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.551654:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf98 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.551668:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf98 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.551705:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:3.0:1787836514.551708:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836514.551712:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad000, rc 0) 00000100:00100000:3.0:1787836514.551786:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10005:x1874682172192256:12345-192.168.203.25@tcp:101:bash.0 Request processed in 263us (7041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836514.551794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:3.0:1787836514.560441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836514.560553:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172192384 00000100:00100000:0.0:1787836514.560564:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172192384 00000100:00100000:0.0:1787836514.560636:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1787836514.560647:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:10005:x1874682172192384:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1787836514.560666:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836514.560688:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edf9f expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787836514.560716:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a90385f, atime: 0x6a90385e, ctime: 0x6a90385f, blocks: 0xb 00010000:00010000:0.0:1787836514.560743:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1787836514.560748:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836514.560756:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.560774:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.560789:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3f400, rc 0) 00000100:00100000:0.0:1787836514.562476:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:10005:x1874682172192384:12345-192.168.203.25@tcp:101:bash.0 Request processed in 1821us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836514.562488:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:2.0:1787836514.566632:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836514.566768:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172192512 00000100:00100000:0.0:1787836514.566786:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172192512 00002000:00010000:0.0:1787836514.566844:0:6696:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787836514.566849:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401fd7840 with x1874682172192512 ext(0->18446744073709551615) 00002000:00010000:0.0:1787836514.566861:0:6696:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e401fd7840. 00000100:00100000:0.0:1787836514.566895:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:0.0:1787836514.566904:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172192512:12345-192.168.203.25@tcp:10:bash.0 00002000:00010000:0.0:1787836514.567269:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787836514.567274:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787836511 -> 1787836513 00002000:00010000:0.0:1787836514.567276:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787836510 -> 1787836510 00002000:00010000:0.0:1787836514.567279:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787836511 -> 1787836513 00002000:00010000:0.0:1787836514.567281:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787836514.567356:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172192512:12345-192.168.203.25@tcp:10:bash.0 Request processed in 452us (733us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787836514.567363:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00002000:00010000:0.0:1787836514.567366:0:6696:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787836514.567369:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401fd7840 with x1874682172192512 ext(0->18446744073709551615) 00002000:00010000:0.0:1787836514.567374:0:6696:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e401fd7840. 00000100:00100000:1.0:1787836514.675969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836514.676117:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172192640 00000100:00100000:3.0:1787836514.676129:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172192640 00000100:00100000:3.0:1787836514.676210:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:3.0:1787836514.676221:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10493:x1874682172192640:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:3.0:1787836514.676325:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.676350:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.676367:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.676385:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.676393:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.676400:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.676940:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.676950:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.676958:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787836514.677005:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677018:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677024:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677031:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677036:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836514.677040:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677048:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677092:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:3.0:1787836514.677097:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836514.677102:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677115:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7afa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677130:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677136:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677142:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677147:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13aca00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836514.677150:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677156:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677164:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d224a600) 00010000:00010000:3.0:1787836514.677167:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836514.677170:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677176:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677268:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677276:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677288:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677293:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836514.677296:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677303:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677311:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:3.0:1787836514.677314:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836514.677317:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.677323:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836514.677438:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10493:x1874682172192640:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 1214us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836514.677449:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:3.0:1787836514.743314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836514.743460:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172192896 00000100:00100000:0.0:1787836514.743473:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172192896 00000100:00100000:0.0:1787836514.743557:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:0.0:1787836514.743566:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+27:10496:x1874682172192896:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836514.743590:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836514.743610:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab7b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfa6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.743688:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.743722:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.743735:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.743752:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.743760:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.743767:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744217:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744228:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744251:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836514.744262:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787836514.744368:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744376:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744383:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744396:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836514.744401:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744409:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744421:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:0.0:1787836514.744424:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836514.744429:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744435:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f000/0x966835ea68ab7b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744449:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744454:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744460:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744465:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836514.744468:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744474:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744493:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d81a4900) 00010000:00010000:0.0:1787836514.744495:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836514.744498:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744504:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e800/0x966835ea68ab7b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744549:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab7b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfa6 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744563:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfa6 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836514.744570:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:0.0:1787836514.744572:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787836514.744575:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3fe00, rc 0) 00000100:00100000:0.0:1787836514.744670:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10496:x1874682172192896:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1105us (1373us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787836514.744679:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:0.0:1787836514.751647:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836514.751739:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172193024 00000100:00100000:3.0:1787836514.751750:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172193024 00000100:00100000:3.0:1787836514.751880:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:3.0:1787836514.751893:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10496:x1874682172193024:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:3.0:1787836514.752010:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.752101:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.752113:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.752154:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.752167:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 29 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836514.752182:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874682193186688:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836514.752449:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3eebf9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787836514.757903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836514.758093:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874682193186688:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836514.758129:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836514.760114:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172193280 00000100:00100000:0.0:1787836514.760134:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172193280 00000100:00100000:0.0:1787836514.760218:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:0.0:1787836514.760238:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+30:5599:x1874682172193280:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787836514.761839:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:5599:x1874682172193280:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 1601us (3938us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787836514.761876:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:0.0:1787836514.772716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836514.776350:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172193408 00000100:00100000:3.0:1787836514.776370:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172193408 00010000:00010000:2.0:1787836514.779300:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 31 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836514.779448:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:2.0:1787836514.779465:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:2364:x1874682172193408:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836514.779485:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836514.779495:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 31 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.779542:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 31 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.779568:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7ad7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf91 expref: 31 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.779598:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:2.0:1787836514.779605:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.779616:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.779626:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.779663:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836514.779745:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+30:2364:x1874682172193408:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 287us (7038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836514.779754:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00010000:00010000:1.0:1787836514.781433:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.781476:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.781525:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.781533:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.781542:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.781548:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836514.781554:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.781562:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.781597:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:1.0:1787836514.781601:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836514.781608:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836514.781615:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836514.781724:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10496:x1874682172193024:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 29831us (30082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836514.781735:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:0.0:1787836514.798272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836514.798462:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172193664 00000100:00100000:1.0:1787836514.798473:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172193664 00000100:00100000:1.0:1787836514.798542:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1787836514.798552:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+29:10496:x1874682172193664:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1787836514.798777:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10496:x1874682172193664:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 225us (513us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787836514.798786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:0.0:1787836514.952155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836514.952326:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172193920 00000100:00100000:3.0:1787836514.952339:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172193920 00000100:00100000:3.0:1787836514.952462:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 94 00000100:00100000:3.0:1787836514.952474:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+30:10507:x1874682172193920:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:3.0:1787836514.952501:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836514.952523:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.952646:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.952671:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.952684:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.952700:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.952707:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.952713:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954256:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954273:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954284:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836514.954296:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787836514.954389:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954397:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954403:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954417:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836514.954422:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954430:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954446:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:3.0:1787836514.954449:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836514.954454:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954459:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954472:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954478:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954484:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954489:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836514.954492:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954497:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954515:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d224a600) 00010000:00010000:3.0:1787836514.954517:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836514.954520:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.954525:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.955332:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfad expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.955346:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfad expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836514.955355:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:3.0:1787836514.955357:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836514.955360:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac800, rc 0) 00000100:00100000:3.0:1787836514.955493:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10507:x1874682172193920:12345-192.168.203.25@tcp:101:cat.0 Request processed in 3022us (3347us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787836514.955503:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 94 00000100:00100000:0.0:1787836514.963884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836514.964108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172194176 00000100:00100000:1.0:1787836514.964120:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172194176 00000100:00100000:1.0:1787836514.964338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:1.0:1787836514.964352:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10507:x1874682172194176:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:1.0:1787836514.964729:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10507:x1874682172194176:12345-192.168.203.25@tcp:35:cat.0 Request processed in 379us (856us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787836514.976452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:1.0:1787836514.991428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836514.991658:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172194432 00000100:00100000:2.0:1787836514.991674:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172194432 00000100:00100000:2.0:1787836514.991753:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 95 00000100:00100000:2.0:1787836514.991765:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10508:x1874682172194432:12345-192.168.203.25@tcp:36:rm.0 00010000:00010000:2.0:1787836514.991855:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787836514.991896:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfad expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.991950:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfa6 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.992512:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf98 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.992639:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d224ac00) 00010000:00010000:2.0:1787836514.992659:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836514.992695:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.992711:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.992724:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.992741:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.992748:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.992755:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.994487:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.994506:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.994537:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836514.998762:0:10086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787836514.998793:0:10086:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363431734179ns, next at 364431729125ns, rc = 0 00010000:00010000:2.0:1787836514.998881:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.998903:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.998917:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.998927:0:10086:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.998934:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.998941:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.998957:0:10086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787836514.998983:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.998990:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.998997:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999010:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836514.999016:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999024:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999040:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034100) 00010000:00010000:2.0:1787836514.999043:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787836514.999048:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999055:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999122:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999128:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999133:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999138:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836514.999140:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999146:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999164:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836514.999167:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836514.999171:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836514.999176:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836514.999186:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000993acb62 reply state 000000005df1622d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836514.999196:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787836515.001857:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836515.001877:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.001890:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836515.001895:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.001906:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.001932:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98e3d8034100) 00010000:00010000:1.0:1787836515.001935:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787836515.001982:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.001988:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7b71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.002027:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836515.002029:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836515.002031:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836515.002482:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+32:10508:x1874682172194432:12345-192.168.203.25@tcp:36:rm.0 Request processed in 10712us (11064us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787836515.002496:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 95 00010000:00010000:3.0:1787836515.009984:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.010010:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.010020:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.010083:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836515.010090:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.010100:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.010124:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d8034900) 00010000:00010000:3.0:1787836515.010128:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836515.010135:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.010141:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836515.054477:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193186816:0@lo:400:kworker.0 00000100:00100000:2.0:1787836515.054590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836515.054670:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193187328:0@lo:400:kworker.0 00000100:00100000:2.0:1787836515.054699:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836515.054735:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787836515.054741:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193187200:0@lo:400:kworker.0 00000100:00100000:3.0:1787836515.055358:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193186816 00000100:00100000:3.0:1787836515.055372:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193186816 00000100:00100000:3.0:1787836515.055443:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787836515.055468:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d83bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193186816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836515.055546:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d83bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193186816:12345-0@lo:400:kworker.0 Request processed in 93us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.055553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787836515.055625:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193187328 00000100:00100000:3.0:1787836515.055630:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193187328 00000100:00100000:3.0:1787836515.055673:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787836515.055682:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193187328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836515.055719:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193187328:12345-0@lo:400:kworker.0 Request processed in 39us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.055745:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787836515.056493:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836515.056690:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193186944:0@lo:400:kworker.0 00000100:00100000:1.0:1787836515.056741:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836515.056787:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193187456:0@lo:400:kworker.0 00000100:00100000:1.0:1787836515.056817:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836515.056844:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836515.056852:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193187072:0@lo:400:kworker.0 00000100:00100000:1.0:1787836515.056892:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787836515.056923:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836515.056942:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193187200 00000100:00100000:1.0:1787836515.056948:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193187200 00000100:00100000:1.0:1787836515.056993:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193187456 00000100:00100000:1.0:1787836515.056996:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193187456 00000100:00100000:1.0:1787836515.057020:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787836515.057030:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193187200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836515.057104:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193187200:12345-0@lo:400:kworker.0 Request processed in 76us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836515.057111:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787836515.057126:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787836515.057132:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193187456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836515.057164:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193187456:12345-0@lo:400:kworker.0 Request processed in 32us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836515.057181:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787836515.057198:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836515.057201:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836515.057240:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193187456:0@lo:400:kworker.0 00000100:00100000:3.0:1787836515.057735:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193187200:0@lo:400:kworker.0 00000100:00100000:3.0:1787836515.057748:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193186816:0@lo:400:kworker.0 00000100:00100000:3.0:1787836515.057759:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193187328:0@lo:400:kworker.0 00000100:00100000:2.0:1787836515.057901:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193186944 00000100:00100000:2.0:1787836515.057906:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193186944 00000100:00100000:2.0:1787836515.057943:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193187072 00000100:00100000:2.0:1787836515.057947:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193187072 00000100:00100000:2.0:1787836515.057990:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787836515.057999:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193186944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836515.058083:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193186944:12345-0@lo:400:kworker.0 Request processed in 62us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.058089:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787836515.058106:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787836515.058112:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193187072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836515.058139:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193187072:12345-0@lo:400:kworker.0 Request processed in 28us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.058144:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787836515.058364:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836515.058390:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193187072:0@lo:400:kworker.0 00000100:00100000:1.0:1787836515.058403:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193186944:0@lo:400:kworker.0 00000100:00100000:1.0:1787836515.093320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.093471:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172194688 00000100:00100000:2.0:1787836515.093484:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172194688 00000100:00100000:2.0:1787836515.093547:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 96 00000100:00100000:2.0:1787836515.093557:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+31:10514:x1874682172194688:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836515.093581:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.093619:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfb4 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.093797:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.093818:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.093831:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.093849:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.093857:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.094124:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787836515.096501:0:10086:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787836515.097469:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.097490:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.097503:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.097543:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.097551:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.097558:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.097563:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836515.097568:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.097575:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.099310:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836515.099320:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836515.099351:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.099360:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7b7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836515.099386:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba0424ad reply state 000000006baa34d8 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836515.099395:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787836515.099483:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7b78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 34 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.099498:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 33 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.099505:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034d00) 00010000:00010000:2.0:1787836515.099507:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836515.099510:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005ae00, rc 0) 00000100:00100000:2.0:1787836515.100457:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+34:10514:x1874682172194688:12345-192.168.203.25@tcp:101:bash.0 Request processed in 6892us (7139us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787836515.100470:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 96 00010000:00010000:1.0:1787836515.111623:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.111642:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.111650:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.111656:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836515.111661:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.111670:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.111688:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d8034500) 00010000:00010000:1.0:1787836515.111691:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836515.111695:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.111719:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7b86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836515.118468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.118982:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172194816 00000100:00100000:3.0:1787836515.118994:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172194816 00000100:00100000:3.0:1787836515.119113:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:3.0:1787836515.119123:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172194816:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836515.119143:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836515.119166:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfbb expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836515.119208:0:10087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836515.119240:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1787836515.119245:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836515.119258:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 6 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.119295:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 6 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.119311:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13aca00, rc 0) 00000100:00100000:3.0:1787836515.119396:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2363:x1874682172194816:12345-192.168.203.25@tcp:101:bash.0 Request processed in 274us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.119428:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00080000:1.0:1787836515.119523:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836515.123238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.123355:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172194944 00000100:00100000:3.0:1787836515.123365:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172194944 00000100:00100000:3.0:1787836515.123428:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:3.0:1787836515.123438:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:10514:x1874682172194944:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836515.123456:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836515.123473:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfc2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.123503:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 7 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.123512:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836515.123516:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836515.123521:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.123560:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 7 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.123573:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 7 pid: 10087 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836515.123586:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1874682193187584:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836515.123697:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3eebf9900 going to sleep for 11 seconds 00000100:00100000:0.0:1787836515.127493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.127611:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1874682193187584:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836515.127640:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172195072 00000100:00100000:1.0:1787836515.127649:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172195072 00010000:00010000:3.0:1787836515.127660:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.127684:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad200, rc 0) 00010000:00010000:1.0:1787836515.127691:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 8 pid: 10087 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836515.127736:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:1.0:1787836515.127745:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8603450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172195072:12345-192.168.203.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787836515.127757:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+8:10514:x1874682172194944:12345-192.168.203.25@tcp:101:bash.0 Request processed in 4319us (4536us total) trans 0 rc 0/0 00010000:00010000:1.0:1787836515.127761:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787836515.127770:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00010000:00010000:1.0:1787836515.127801:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 7 pid: 10087 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.127817:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 7 pid: 10087 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.127843:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b33a7f/0x966835ea68ab7b9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfbb expref: 7 pid: 10087 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.127861:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836515.127865:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836515.127873:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.127904:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.127945:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836515.127959:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c828a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1874682193187712:192.168.203.25@tcp:105: 00000100:00100000:1.0:1787836515.128016:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836515.136019:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c828a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1874682193187712:192.168.203.25@tcp:105: 00010000:00010000:3.0:1787836515.136051:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836515.136146:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8603450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172195072:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 8400us (8664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.136159:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:2.0:1787836515.147467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836515.147568:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172195328 00000100:00100000:0.0:1787836515.147577:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172195328 00000100:00100000:0.0:1787836515.147633:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1787836515.147643:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+33:10514:x1874682172195328:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:0.0:1787836515.148172:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+34:10514:x1874682172195328:12345-192.168.203.25@tcp:35:bash.0 Request processed in 529us (712us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787836515.148180:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1787836515.426375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.426475:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172195456 00000100:00100000:3.0:1787836515.426486:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172195456 00000100:00100000:3.0:1787836515.426547:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:3.0:1787836515.426559:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+34:10530:x1874682172195456:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836515.426582:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836515.426604:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7ba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfc9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.426669:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab7bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.426683:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab7bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.426693:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab7bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836515.426787:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787836515.426792:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836515.426821:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab7bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.426850:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7ba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc9 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.426871:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab7bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc9 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.426880:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:3.0:1787836515.426885:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787836515.426888:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13acc00, rc 0) 00000100:00100000:3.0:1787836515.426971:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+35:10530:x1874682172195456:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 416us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.426979:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:1.0:1787836515.437445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.437621:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172195712 00000100:00100000:2.0:1787836515.437631:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172195712 00000100:00100000:2.0:1787836515.437698:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00100000:2.0:1787836515.437708:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+35:10530:x1874682172195712:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836515.437730:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.437762:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7bb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfd0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.437879:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.437895:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.437908:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836515.437920:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787836515.438054:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfd0 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.438124:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfd0 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.438131:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034d00) 00010000:00010000:2.0:1787836515.438135:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836515.438138:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836515.438200:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+37:10530:x1874682172195712:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 493us (768us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787836515.438215:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00100000:2.0:1787836515.441631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836515.441699:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172195968 00000100:00100000:0.0:1787836515.441709:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172195968 00000100:00100000:0.0:1787836515.441762:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00100000:0.0:1787836515.441773:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+37:10530:x1874682172195968:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836515.441799:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836515.441835:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7bcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfd7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.441932:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7bd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.441947:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.441976:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836515.441992:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787836515.442149:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7bcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfd7 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.442167:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7bd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfd7 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.442175:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034d00) 00010000:00010000:0.0:1787836515.442178:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787836515.442182:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3e400, rc 0) 00000100:00100000:0.0:1787836515.442241:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+39:10530:x1874682172195968:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 469us (620us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787836515.442248:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00100000:1.0:1787836515.442414:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.443980:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172196096 00000100:00100000:2.0:1787836515.443993:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172196096 00000100:00100000:2.0:1787836515.444095:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1787836515.444107:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+39:2361:x1874682172196096:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836515.444143:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836515.444170:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfd0 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.444192:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034d00) 00010000:00010000:2.0:1787836515.444197:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836515.444275:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+38:2361:x1874682172196096:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 171us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.444283:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:1.0:1787836515.450760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836515.450919:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172196224 00000100:00100000:0.0:1787836515.450929:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172196224 00000100:00100000:0.0:1787836515.450997:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:0.0:1787836515.451009:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8289680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172196224:12345-192.168.203.25@tcp:1:lfs.0 00010000:00010000:0.0:1787836515.451083:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.451106:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.451115:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836515.451134:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787836515.451139:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.451177:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.451192:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 6 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836515.451207:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1874682193187840:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836515.451322:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981840 going to sleep for 11 seconds 00000100:00100000:2.0:1787836515.458702:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1874682193187840:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836515.458745:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836515.461359:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.461542:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172196352 00000100:00100000:3.0:1787836515.461556:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172196352 00002000:00100000:3.0:1787836515.461626:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98e3c828a580 x1874682172196352/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:301/0 lens 504/0 e 0 to 0 dl 1787836526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787836515.461639:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3c828a580 with x1874682172196352 ext(0->8) 00010000:00010000:3.0:1787836515.461651:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 7 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.461670:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 7 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836515.461705:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e3c828a580 00000100:00100000:3.0:1787836515.461756:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1787836515.461774:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172196352:12345-192.168.203.25@tcp:4:lfs.0 00000100:00100000:3.0:1787836515.463445:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172196352:12345-192.168.203.25@tcp:4:lfs.0 Request processed in 1668us (2092us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787836515.465215:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00002000:00100000:3.0:1787836515.465247:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98e3c828a580 x1874682172196352/t4294967302(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:301/0 lens 504/448 e 0 to 0 dl 1787836526 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787836515.465259:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3c828a580 with x1874682172196352 ext(0->8) 00010000:00010000:3.0:1787836515.465273:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 9 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.465291:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 9 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836515.465299:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e3c828a580 00000100:00100000:0.0:1787836515.470929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.471186:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172196480 00000100:00100000:2.0:1787836515.471201:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172196480 00010000:00010000:2.0:1787836515.471271:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 9 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836515.471322:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:2.0:1787836515.471333:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2364:x1874682172196480:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836515.471350:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787836515.471377:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787836515.471380:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787836514 00002000:00010000:2.0:1787836515.471383:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787836514 00002000:00010000:2.0:1787836515.471385:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787836514 00010000:00010000:2.0:1787836515.471393:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 9 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.471433:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 9 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.471481:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3f8981e/0x966835ea68ab7ba2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc2 expref: 9 pid: 6693 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.471502:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836515.471507:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836515.471513:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.471523:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.471563:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836515.471644:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172196480:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 312us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.471652:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00010000:00010000:3.0:1787836515.471981:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.471993:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.472025:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.472044:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.472052:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.472104:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f800 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836515.472109:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.472119:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.472133:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.472141:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bceb7c58/0x966835ea68ab7be1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836515.472198:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8289680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172196224:12345-192.168.203.25@tcp:1:lfs.0 Request processed in 21191us (21448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.472207:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:1.0:1787836515.475382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.476800:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172196736 00000100:00100000:3.0:1787836515.476837:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172196736 00000100:00100000:3.0:1787836515.476931:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:3.0:1787836515.476961:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+38:10530:x1874682172196736:12345-192.168.203.25@tcp:35:lfs.0 00000004:00010000:3.0:1787836515.477047:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7bd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfd7 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787836515.477389:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787836515.477439:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787836515.477787:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787836515.477840:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.477856:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 42 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.477865:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.477903:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 42 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.477920:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 42 pid: 10086 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836515.477936:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a63480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874682193187968:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836515.478051:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3eebf9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787836515.483919:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a63480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874682193187968:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836515.483955:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836515.484192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.484669:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172196864 00000100:00100000:3.0:1787836515.484677:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172196864 00010000:00010000:3.0:1787836515.484716:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 43 pid: 10086 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836515.484989:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:3.0:1787836515.485000:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+43:2363:x1874682172196864:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836515.485018:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836515.485026:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 43 pid: 10086 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.485040:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 43 pid: 10086 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.485103:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7b8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfb4 expref: 43 pid: 10086 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.485120:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034d00) 00010000:00010000:3.0:1787836515.485125:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.485134:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.485141:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.485172:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836515.485245:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+42:2363:x1874682172196864:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 246us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.485253:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00010000:00010000:1.0:1787836515.485708:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.485717:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836515.485863:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787836515.486101:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787836515.486211:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc0b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193188096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787836515.486280:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836515.486319:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50840 going to sleep for 11 seconds 00000100:00100000:0.0:1787836515.486442:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193188096 00000100:00100000:0.0:1787836515.486449:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193188096 00000100:00100000:0.0:1787836515.486512:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787836515.486521:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1874682193188096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787836515.486622:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1874682193188096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836515.486629:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836515.486911:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc0b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193188096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787836515.489522:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787836515.489639:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193188224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787836515.489709:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836515.489739:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836515.490428:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193188224 00000100:00100000:0.0:1787836515.490437:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193188224 00000100:00100000:0.0:1787836515.490500:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787836515.490509:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1874682193188224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787836515.490740:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5844:x1874682193188224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 231us (1030us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787836515.490748:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836515.491618:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193188224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787836515.491705:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787836515.491757:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.491780:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.491789:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.491796:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836515.491811:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.491821:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.491839:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034d00) 00010000:00010000:1.0:1787836515.491842:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787836515.491847:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836515.491853:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7be8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836515.492054:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787836515.492192:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787836515.492204:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363925144936ns, next at 364925142516ns, rc = 0 00000001:00080000:1.0:1787836515.492211:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787836515.492257:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034d00) 00010000:00010000:1.0:1787836515.492260:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787836515.492269:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7bd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfd7 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836515.492385:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+45:10530:x1874682172196736:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 15427us (17018us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787836515.492394:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000020:00080000:1.0:1787836515.492399:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787836515.496094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.496181:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172196992 00000100:00100000:2.0:1787836515.496191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172196992 00000100:00100000:2.0:1787836515.496259:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00100000:2.0:1787836515.496270:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+45:10530:x1874682172196992:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836515.496293:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.496315:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7bef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfde expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.496392:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7bef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfde expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.496406:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7bef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfde expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.496424:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836515.496428:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787836515.496432:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005aa00, rc 0) 00000100:00100000:2.0:1787836515.496501:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+46:10530:x1874682172196992:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 234us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.496508:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00100000:0.0:1787836515.499390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.499595:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172197248 00000100:00100000:3.0:1787836515.499606:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172197248 00000100:00100000:3.0:1787836515.499671:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:3.0:1787836515.499681:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+46:10530:x1874682172197248:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836515.500046:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+47:10530:x1874682172197248:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 364us (664us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787836515.500054:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00010000:00010000:2.0:1787836515.503278:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836515.570445:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836515.570484:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193188352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836515.570577:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836515.571953:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193188352 00000100:00100000:0.0:1787836515.571965:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193188352 00000100:00100000:0.0:1787836515.572091:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787836515.572103:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1874682193188352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836515.572136:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836515.572254:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1874682193188352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836515.572262:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787836515.572474:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193188352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787836515.630434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.630919:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172197376 00000100:00100000:2.0:1787836515.630930:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172197376 00000100:00100000:2.0:1787836515.630992:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00100000:2.0:1787836515.631003:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+47:10540:x1874682172197376:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:2.0:1787836515.631120:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631139:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631156:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631194:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631202:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631210:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631326:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631335:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631343:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836515.631382:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631394:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631401:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631408:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631414:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005ae00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836515.631419:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631433:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631447:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836515.631451:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836515.631457:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631464:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7bf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631475:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631482:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631488:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631494:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836515.631497:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.631504:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632120:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d8034800) 00010000:00010000:2.0:1787836515.632125:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836515.632130:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632148:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632168:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632174:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632180:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632185:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836515.632188:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632194:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632203:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836515.632205:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836515.632207:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.632212:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836515.632326:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+47:10540:x1874682172197376:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 1321us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.632334:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00100000:1.0:1787836515.678208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.678294:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172197632 00000100:00100000:2.0:1787836515.678307:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172197632 00000100:00100000:2.0:1787836515.678375:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00100000:2.0:1787836515.678387:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+47:10543:x1874682172197632:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836515.678416:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.678440:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfe5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678565:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678587:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678601:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678619:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678626:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678632:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678775:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7c20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678785:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678827:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836515.678838:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787836515.678967:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678975:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678981:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678987:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836515.678991:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.678998:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679011:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836515.679014:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836515.679019:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679025:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679042:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679048:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679120:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679125:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005ae00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836515.679127:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679134:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679142:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d8034800) 00010000:00010000:2.0:1787836515.679145:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836515.679148:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679153:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679205:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfe5 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679218:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfe5 expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.679239:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836515.679241:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836515.679244:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b800, rc 0) 00000100:00100000:2.0:1787836515.679329:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+49:10543:x1874682172197632:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 943us (1131us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787836515.679349:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00100000:0.0:1787836515.695352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.695592:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172197760 00000100:00100000:3.0:1787836515.695606:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172197760 00000100:00100000:3.0:1787836515.695684:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 103 00000100:00100000:3.0:1787836515.695696:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+49:10543:x1874682172197760:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:3.0:1787836515.695782:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695804:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695818:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695848:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695856:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695883:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695889:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836515.695895:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695903:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695918:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836515.695921:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787836515.695927:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.695933:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836515.696027:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+49:10543:x1874682172197760:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 333us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.696035:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 103 00000100:00100000:3.0:1787836515.700653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836515.700751:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172198016 00000100:00100000:1.0:1787836515.700761:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172198016 00000100:00100000:1.0:1787836515.700828:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:1.0:1787836515.700839:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+49:10543:x1874682172198016:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1787836515.701336:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+50:10543:x1874682172198016:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 497us (690us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787836515.701345:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:1.0:1787836515.844932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.845036:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172198272 00000100:00100000:2.0:1787836515.845047:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172198272 00000100:00100000:2.0:1787836515.845151:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 104 00000100:00100000:2.0:1787836515.845162:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+50:10553:x1874682172198272:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836515.845187:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.845190:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787836515.845219:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab7bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfc9 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.845246:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836515.845251:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836515.845265:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edfec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.845370:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.845385:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.845397:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836515.845409:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787836515.845554:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfec expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.845588:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfec expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.845596:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836515.845599:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836515.845602:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005ae00, rc 0) 00000100:00100000:2.0:1787836515.845674:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+51:10553:x1874682172198272:12345-192.168.203.25@tcp:101:bash.0 Request processed in 514us (756us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787836515.845682:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 104 00000100:00100000:0.0:1787836515.862541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.862905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172198528 00000100:00100000:3.0:1787836515.862918:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172198528 00000100:00100000:3.0:1787836515.862993:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 105 00000100:00100000:3.0:1787836515.863004:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+51:10553:x1874682172198528:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:3.0:1787836515.863110:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787836515.863138:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfec expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.863185:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7c20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfe5 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.863195:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836515.863200:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836515.863489:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.863514:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.863524:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787836515.863578:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787836515.863619:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000378edb88 reply state 00000000260b35df transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836515.863629:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787836515.866021:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+52:10553:x1874682172198528:12345-192.168.203.25@tcp:36:bash.0 Request processed in 3005us (3475us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787836515.866034:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 105 00000020:00080000:3.0:1787836515.866041:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787836515.873949:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.873968:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.873975:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.873981:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836515.873986:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.873993:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.874011:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:0.0:1787836515.874013:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836515.874019:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.874040:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7c4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836515.874686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.874797:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172198656 00000100:00100000:2.0:1787836515.874809:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172198656 00000100:00100000:2.0:1787836515.874874:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 106 00000100:00100000:2.0:1787836515.874883:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+51:10553:x1874682172198656:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836515.874909:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.874928:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edff3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.875015:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.875029:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.875039:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836515.875113:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787836515.875130:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836515.875152:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.875180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.875194:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.875202:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836515.875205:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836515.875209:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836515.875273:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+52:10553:x1874682172198656:12345-192.168.203.25@tcp:101:bash.0 Request processed in 390us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.875281:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 106 00000100:00100000:3.0:1787836515.880344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836515.880519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172198912 00000100:00100000:1.0:1787836515.880531:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172198912 00000100:00100000:1.0:1787836515.880620:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:1.0:1787836515.880632:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+52:10553:x1874682172198912:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:1.0:1787836515.880932:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+53:10553:x1874682172198912:12345-192.168.203.25@tcp:35:bash.0 Request processed in 302us (601us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787836515.880940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:1.0:1787836515.961719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.961875:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172199040 00000100:00100000:2.0:1787836515.961887:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172199040 00000100:00100000:2.0:1787836515.961953:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 107 00000100:00100000:2.0:1787836515.961964:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeace1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+53:10559:x1874682172199040:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836515.961995:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.962018:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000edffa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.962137:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7c66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.962154:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.962184:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836515.962257:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787836515.962261:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836515.962282:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.962306:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edffa expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.962322:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7c66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edffa expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.962330:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836515.962333:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836515.962337:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005be00, rc 0) 00000100:00100000:2.0:1787836515.962394:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeace1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+54:10559:x1874682172199040:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 432us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.962401:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 107 00000100:00100000:0.0:1787836515.970482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.970564:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172199168 00000100:00100000:2.0:1787836515.970574:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172199168 00000100:00100000:2.0:1787836515.970635:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00100000:2.0:1787836515.970646:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+54:10559:x1874682172199168:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836515.970666:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.970687:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee001 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.970814:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.970829:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.970841:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.970865:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.970873:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.970880:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.970991:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971000:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971008:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836515.971042:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787836515.971046:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836515.971084:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971109:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971118:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971125:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971131:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971137:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836515.971141:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971148:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971160:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836515.971162:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836515.971167:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971173:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7c74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971187:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971193:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971205:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971209:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836515.971212:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971218:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971237:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d8034800) 00010000:00010000:2.0:1787836515.971240:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836515.971242:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971248:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971283:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971297:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.971304:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836515.971306:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836515.971308:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836515.971378:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+55:10559:x1874682172199168:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 734us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836515.971395:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00100000:0.0:1787836515.978274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836515.978437:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172199424 00000100:00100000:2.0:1787836515.978461:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172199424 00000100:00100000:2.0:1787836515.978537:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 109 00000100:00100000:2.0:1787836515.978549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+55:10559:x1874682172199424:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836515.978581:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836515.978609:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee008 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.978743:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.978781:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.978790:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.978798:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.978833:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.978848:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836515.978862:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193188480:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836515.979523:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.979536:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836515.979547:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193188608:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836515.979587:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787836515.991289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836515.995259:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172199552 00000100:00100000:3.0:1787836515.995279:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172199552 00010000:00010000:3.0:1787836515.995331:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836515.995397:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:3.0:1787836515.995407:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+57:2364:x1874682172199552:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836515.995424:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836515.995431:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.995443:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.995477:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836515.995483:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.995493:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836515.995500:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836515.995573:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+57:2364:x1874682172199552:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 167us (4294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836515.996298:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1787836515.997280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836515.997360:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172199680 00000100:00100000:0.0:1787836515.997368:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172199680 00010000:00010000:0.0:1787836515.997406:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836515.997448:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1787836515.997468:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+57:2363:x1874682172199680:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836515.997487:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836515.997496:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.997513:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.997540:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:0.0:1787836515.997545:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.997556:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.997584:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836515.997607:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836515.997678:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+57:2363:x1874682172199680:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 212us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836515.997686:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00010000:00010000:2.0:1787836515.998860:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.25@tcp) returned -22 from blocking AST (req@00000000a6449689 x1874682193188480) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.998884:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7c82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee001 expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836515.998901:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193188480:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836515.998917:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edff3 expref: 55 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836515.998927:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193188608:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836515.999248:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836515.999258:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.999267:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.999295:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836515.999318:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787836515.999493:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.999510:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836515.999517:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836515.999520:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787836515.999522:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a000, rc 0) 00000100:00100000:2.0:1787836515.999600:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+55:10559:x1874682172199424:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 21052us (21337us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787836515.999609:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 109 00000100:00100000:1.0:1787836516.005239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836516.005321:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172199936 00000100:00100000:3.0:1787836516.005331:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172199936 00000100:00100000:3.0:1787836516.005420:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1787836516.005433:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+55:10559:x1874682172199936:12345-192.168.203.25@tcp:103:lfs.0 00010000:00010000:3.0:1787836516.005460:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836516.005488:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edfde expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836516.005519:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836516.005523:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836516.005584:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+54:10559:x1874682172199936:12345-192.168.203.25@tcp:103:lfs.0 Request processed in 155us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836516.005592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00080000:1.0:1787836516.006951:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836516.014642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836516.014761:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172200064 00000100:00100000:2.0:1787836516.014776:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172200064 00000100:00100000:2.0:1787836516.014859:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 110 00000100:00100000:2.0:1787836516.014872:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+54:10559:x1874682172200064:12345-192.168.203.25@tcp:58:lfs.0 00010000:00010000:2.0:1787836516.015036:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836516.015104:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836516.015121:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836516.015440:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787836516.015544:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+54:10559:x1874682172200064:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 673us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836516.015553:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 110 00000100:00100000:0.0:1787836516.024351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836516.024424:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172200192 00000100:00100000:3.0:1787836516.024433:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172200192 00000100:00100000:3.0:1787836516.024493:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 111 00000100:00100000:3.0:1787836516.024502:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+54:10559:x1874682172200192:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836516.024519:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836516.024538:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee00f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836516.024591:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836516.024602:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee00f expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836516.024619:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836516.024631:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee00f expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836516.024643:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836516.024660:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836516.024665:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee00f expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836516.024673:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13aca00, rc 0) 00000100:00100000:3.0:1787836516.024731:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+55:10559:x1874682172200192:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 230us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836516.024739:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 111 00000001:00080000:2.0:1787836516.179260:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787836516.179289:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1787836516.530267:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787836516.976273:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836516.976285:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836516.976413:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787836516.976424:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787836516.977662:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9a580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193188736:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787836516.978839:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787836516.990356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836516.990524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172200320 00000100:00100000:2.0:1787836516.990536:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172200320 00000100:00100000:2.0:1787836516.990613:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 112 00000100:00100000:2.0:1787836516.990625:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+56:10562:x1874682172200320:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787836516.990668:0:5841:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787836516.990815:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+56:10562:x1874682172200320:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 192us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836516.990823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 112 00000100:00100000:1.0:1787836516.992488:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9a580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193188736:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787836516.994032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836516.994589:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172200448 00000100:00100000:0.0:1787836516.994600:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172200448 00000100:00100000:0.0:1787836516.994672:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:0.0:1787836516.994682:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+55:10562:x1874682172200448:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787836516.994766:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994785:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994798:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994856:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994864:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994871:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994910:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994919:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994926:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836516.994963:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787836516.994967:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836516.994978:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994988:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.994995:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995002:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995018:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ec00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836516.995022:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995030:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995042:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:0.0:1787836516.995050:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836516.995055:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995086:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7cac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995101:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995107:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995113:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995119:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836516.995121:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995126:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995133:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff98e3d81a4700) 00010000:00010000:0.0:1787836516.995135:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836516.995138:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995142:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995505:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995521:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995527:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995532:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836516.995535:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995540:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995549:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:0.0:1787836516.995552:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836516.995555:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836516.995561:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836516.995724:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+55:10562:x1874682172200448:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 1040us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836516.995734:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:3.0:1787836517.003348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.007827:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172200704 00000100:00100000:2.0:1787836517.007845:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172200704 00000100:00100000:2.0:1787836517.007971:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00100000:2.0:1787836517.007982:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+55:10562:x1874682172200704:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836517.008004:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836517.008026:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7cc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee016 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008167:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008184:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008211:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836517.008234:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787836517.008330:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008338:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008346:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008352:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836517.008358:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008365:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008377:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836517.008381:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787836517.008386:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008392:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008433:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7cc1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee016 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008458:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:2.0:1787836517.008461:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836517.008466:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7cc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee016 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.008476:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836517.008549:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+56:10562:x1874682172200704:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 569us (5216us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787836517.008556:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 114 00000100:00100000:1.0:1787836517.019813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.019905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172200832 00000100:00100000:2.0:1787836517.019917:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172200832 00000100:00100000:2.0:1787836517.019992:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:2.0:1787836517.020005:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+56:10562:x1874682172200832:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787836517.020049:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787836517.020243:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+56:10562:x1874682172200832:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 240us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.020250:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:3.0:1787836517.033880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.040943:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172201088 00000100:00100000:0.0:1787836517.040969:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172201088 00000100:00100000:0.0:1787836517.041092:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:0.0:1787836517.041104:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+56:10562:x1874682172201088:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787836517.041135:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836517.041168:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787836517.041201:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7c66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edffa expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.041234:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:0.0:1787836517.041240:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836517.041255:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee01d expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787836517.041751:0:10086:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787836517.042005:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.042019:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.042031:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.042148:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7cd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee01d expref: 58 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.042166:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee01d expref: 57 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.042175:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d81a4700) 00010000:00010000:0.0:1787836517.042178:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836517.042181:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3e000, rc 0) 00000100:00100000:0.0:1787836517.042271:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+57:10562:x1874682172201088:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1168us (8403us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787836517.042293:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:3.0:1787836517.048041:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.048680:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172201344 00000100:00100000:0.0:1787836517.048693:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172201344 00000100:00100000:2.0:1787836517.048810:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:2.0:1787836517.048823:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+57:10562:x1874682172201344:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787836517.048885:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836517.048915:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7cdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee01d expref: 57 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.048935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d81a4700) 00010000:00010000:2.0:1787836517.048961:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836517.048986:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.048999:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049009:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049022:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049029:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049035:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049146:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049153:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049159:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049166:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836517.049171:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049178:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049193:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836517.049195:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836517.049200:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049206:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7ceb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049227:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049233:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049238:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049243:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836517.049245:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049251:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049259:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc871b6dd (ffff98e3d8034800) 00010000:00010000:2.0:1787836517.049262:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836517.049264:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.049269:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc871b6dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.049367:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+56:10562:x1874682172201344:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 547us (1335us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787836517.049375:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:1.0:1787836517.063368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.064623:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172201472 00000100:00100000:2.0:1787836517.064638:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172201472 00000100:00100000:2.0:1787836517.064726:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:2.0:1787836517.064736:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+56:10562:x1874682172201472:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836517.064759:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836517.064785:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee024 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.064829:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.064843:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.064856:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.064965:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.064983:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.064992:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:2.0:1787836517.065001:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787836517.065005:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836517.065127:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+57:10562:x1874682172201472:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 392us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.065134:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:3.0:1787836517.068246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.069709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172201728 00000100:00100000:0.0:1787836517.069730:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172201728 00000100:00100000:0.0:1787836517.069825:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:0.0:1787836517.069837:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+57:10562:x1874682172201728:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787836517.069955:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.069976:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.069989:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787836517.070334:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787836517.070344:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365503284901ns, next at 366503282265ns, rc = 0 00000004:00010000:0.0:1787836517.070441:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f39cdfd reply state 000000004dcf45ab transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836517.070450:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787836517.070556:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+59:10562:x1874682172201728:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 720us (2320us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787836517.070564:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 119 00010000:00010000:3.0:1787836517.079107:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.079125:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.079134:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.079141:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836517.079145:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.079154:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.079170:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:3.0:1787836517.079189:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787836517.079194:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.079201:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7d07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836517.086563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.086741:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172201856 00000100:00100000:2.0:1787836517.086754:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172201856 00000100:00100000:2.0:1787836517.086836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:2.0:1787836517.086847:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+58:10562:x1874682172201856:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836517.086877:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836517.086904:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee02b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.086978:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.086994:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.087015:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:2.0:1787836517.087018:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787836517.087023:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836517.087122:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+59:10562:x1874682172201856:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 276us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.087129:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:1.0:1787836517.096974:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.098654:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172201984 00000100:00100000:2.0:1787836517.098671:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172201984 00000100:00100000:2.0:1787836517.098791:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:2.0:1787836517.098803:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172201984:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787836517.099258:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2364:x1874682172201984:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 456us (2291us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787836517.099267:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00080000:1.0:1787836517.100816:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836517.102434:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193188864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836517.102531:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836517.104444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.108322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172202240 00000100:00100000:0.0:1787836517.108374:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172202240 00000100:00100000:0.0:1787836517.108480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:0.0:1787836517.108494:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+59:10562:x1874682172202240:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787836517.108791:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+60:10562:x1874682172202240:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 299us (4358us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787836517.108800:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:1.0:1787836517.111902:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193188864 00000100:00100000:1.0:1787836517.111924:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193188864 00000100:00100000:1.0:1787836517.112031:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787836517.112043:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193188864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787836517.112112:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836517.112233:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193188864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (9700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836517.112240:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787836517.112349:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836517.112612:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193188864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836517.112681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.112760:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172202496 00000100:00100000:3.0:1787836517.112767:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172202496 00000100:00100000:3.0:1787836517.112814:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:3.0:1787836517.112823:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+60:10562:x1874682172202496:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787836517.112927:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+60:10562:x1874682172202496:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836517.112934:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:3.0:1787836517.115470:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.115588:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172202624 00000100:00100000:2.0:1787836517.115600:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172202624 00000100:00100000:2.0:1787836517.115674:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:2.0:1787836517.115685:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+60:10562:x1874682172202624:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836517.115711:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836517.115734:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee032 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.115826:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.115842:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.115854:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836517.115895:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836517.115914:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.115943:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee032 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.115981:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee032 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.115990:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:2.0:1787836517.115993:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787836517.115996:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005be00, rc 0) 00000100:00100000:2.0:1787836517.116137:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+61:10562:x1874682172202624:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 455us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.116145:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:1.0:1787836517.135917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.136036:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172202752 00000100:00100000:3.0:1787836517.136049:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172202752 00000100:00100000:3.0:1787836517.136165:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:3.0:1787836517.136178:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172202752:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836517.136201:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836517.136237:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee039 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836517.136267:0:10087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a903864, blocks: 0x1 00010000:00010000:3.0:1787836517.136320:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1787836517.136326:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836517.136338:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 10 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.136360:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 10 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.136376:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad000, rc 0) 00000100:00100000:3.0:1787836517.136446:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+10:2363:x1874682172202752:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 271us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836517.136454:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:1.0:1787836517.144368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.144703:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172203008 00000100:00100000:3.0:1787836517.144716:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172203008 00000100:00100000:3.0:1787836517.144792:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:3.0:1787836517.144804:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+61:10562:x1874682172203008:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787836517.144938:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+61:10562:x1874682172203008:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 136us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836517.144946:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:1.0:1787836517.149189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.149288:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172203136 00000100:00100000:3.0:1787836517.149297:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172203136 00000100:00100000:3.0:1787836517.149370:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:3.0:1787836517.149380:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1327c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+10:10562:x1874682172203136:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836517.149400:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836517.149419:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee040 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.149471:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 11 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.149479:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836517.149483:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836517.149488:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.149520:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 11 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.149532:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 11 pid: 10087 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836517.149547:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1874682193188992:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836517.149661:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec480 going to sleep for 11 seconds 00000100:00100000:1.0:1787836517.162278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.162669:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172203264 00000100:00100000:2.0:1787836517.162680:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172203264 00010000:00010000:2.0:1787836517.162727:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 12 pid: 10087 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836517.162935:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae81680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1874682193188992:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836517.162965:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.162983:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac800, rc 0) 00000100:00100000:3.0:1787836517.163045:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1327c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+12:10562:x1874682172203136:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 13666us (13865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836517.163053:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1787836517.163113:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:2.0:1787836517.163122:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8600050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+11:2363:x1874682172203264:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836517.163136:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836517.163159:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 11 pid: 10087 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.163174:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 11 pid: 10087 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.163195:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4dc3c4f/0x966835ea68ab7d23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee039 expref: 11 pid: 10087 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.163238:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836517.163243:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836517.163253:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.163265:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.163301:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.163315:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1874682193189120:192.168.203.25@tcp:105: 00000100:00100000:2.0:1787836517.163366:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787836517.168560:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1874682193189120:192.168.203.25@tcp:105: 00010000:00010000:2.0:1787836517.168592:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836517.168663:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8600050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+10:2363:x1874682172203264:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 5541us (6397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.168675:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1787836517.171410:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.171859:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172203392 00000100:00100000:2.0:1787836517.171869:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172203392 00002000:00100000:2.0:1787836517.171918:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98e3c1324780 x1874682172203392/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:303/0 lens 504/0 e 0 to 0 dl 1787836528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836517.171929:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3c1324780 with x1874682172203392 ext(0->12) 00002000:00010000:2.0:1787836517.171934:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e3c1324780 00000100:00100000:2.0:1787836517.171980:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:2.0:1787836517.171989:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1324780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+10:2361:x1874682172203392:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787836517.172556:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1324780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+12:2361:x1874682172203392:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 Request processed in 566us (1157us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787836517.172566:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00002000:00100000:2.0:1787836517.172589:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98e3c1324780 x1874682172203392/t4294967308(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:303/0 lens 504/448 e 0 to 0 dl 1787836528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836517.172599:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3c1324780 with x1874682172203392 ext(0->12) 00002000:00010000:2.0:1787836517.172603:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e3c1324780 00000100:00100000:1.0:1787836517.179352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.179453:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172203520 00000100:00100000:0.0:1787836517.179464:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172203520 00000100:00100000:0.0:1787836517.179530:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:0.0:1787836517.179543:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1324b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+61:10562:x1874682172203520:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787836517.290407:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787836517.290428:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787836517.290457:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e3e973d240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787836517.290462:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e401afba00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e3e973d9c0 00000020:00080000:3.0:1787836517.290466:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e401afb800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e3f5ae9000 00000020:00080000:3.0:1787836517.290503:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000100:00100000:1.0:1787836517.290979:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836517.291002:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c1326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193189248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787836517.291087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787836517.291329:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787836517.291419:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836517.291430:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c1325e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193189376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787836517.291463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836517.291502:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193189248 00000100:00100000:1.0:1787836517.291511:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193189248 00000100:00100000:1.0:1787836517.291558:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193189376 00000100:00100000:1.0:1787836517.291561:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193189376 00000100:00100000:1.0:1787836517.291583:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787836517.291593:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1874682193189248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787836517.291622:0:10087:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787836517.291972:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.291998:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.292031:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1787836517.292036:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787836517.292044:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.292117:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.292132:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 11 pid: 6691 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836517.292145:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fb944b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193189504:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836517.292229:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836517.292251:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787836517.292260:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1874682193189376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787836517.292429:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787836517.292434:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787836516 00002000:00010000:1.0:1787836517.292437:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787836517.292439:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787836516 -> 1787836516 00002000:00010000:1.0:1787836517.292441:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787836517.292497:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1874682193189376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 237us (1031us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787836517.292505:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1787836517.293011:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e3c1325e00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787836517.293029:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c1325e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193189376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1787836517.293367:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787836517.293398:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e3c5f50840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787836517.293403:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e401e7d500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e3c5f506c0 00000020:00080000:0.0:1787836517.293406:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e401e7da00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e3c12ab000 00000004:00080000:0.0:1787836517.293450:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787836517.293507:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787836517.293567:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787836517.293860:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193189632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787836517.293920:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836517.294354:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193189632 00000100:00100000:2.0:1787836517.294363:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193189632 00000100:00100000:2.0:1787836517.294434:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787836517.294444:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193189632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787836517.294474:0:6693:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787836517.294509:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a903862, atime: 0x6a903862, ctime: 0x6a903862, blocks: 0xb 00010000:00010000:2.0:1787836517.294518:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.294535:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787836517.294540:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836517.294547:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.294564:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.294592:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.294601:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.294621:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1787836517.294929:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836517.295839:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1324b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+15:10562:x1874682172203520:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 116291us (116493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836517.295851:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:2.0:1787836517.296052:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193189632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1609us (2131us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787836517.296091:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1787836517.296129:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836517.296140:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.296153:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836517.296158:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.296170:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.296193:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.296201:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab7d38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.296252:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836517.296255:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836517.296257:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836517.303031:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787836517.303047:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1787836517.303100:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e3eeaced00, transno 4294967301 00000004:00080000:0.0:1787836517.303115:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1787836517.303143:0:3311:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98e401fd5680 x1874682193189632/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787836533 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787836517.303184:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e401fd5680/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787836517.303191:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193189632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787836517.304430:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fb944b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193189504:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836517.304457:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836517.309888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.312380:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172203648 00000100:00100000:3.0:1787836517.312397:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172203648 00010000:00010000:3.0:1787836517.312453:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 12 pid: 6691 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836517.312515:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:3.0:1787836517.312526:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb945680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+12:2364:x1874682172203648:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836517.312541:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836517.312546:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 12 pid: 6691 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.312560:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 12 pid: 6691 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.312585:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a900809f/0x966835ea68ab7af3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf9f expref: 12 pid: 6691 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.312601:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836517.312605:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836517.312626:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.312653:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.314111:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836517.314209:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb945680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+11:2364:x1874682172203648:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1678us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836517.314232:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00010000:00010000:2.0:1787836517.314396:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.314410:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.314420:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.314428:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.314452:0:10087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787836517.315149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00010000:00010000:3.0:1787836517.316032:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836517.316043:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.316080:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836517.316085:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.316096:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.316118:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.316126:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8b32f67/0x966835ea68ab7d31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.316162:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836517.316164:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836517.316166:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836517.317106:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1874682193189248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25507us (26012us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787836517.317118:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787836517.317153:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172203776 00000100:00100000:2.0:1787836517.317161:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172203776 00000100:00100000:2.0:1787836517.317234:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:2.0:1787836517.317244:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb9443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+11:2363:x1874682172203776:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1787836517.317540:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e3c1326940/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787836517.317550:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c1326940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193189248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787836517.452847:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb9443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+11:2363:x1874682172203776:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 134490us (136588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836517.452869:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000001:00080000:1.0:1787836517.452933:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1787836517.452950:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787836517.452957:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1787836517.452962:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1787836517.462377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.462476:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172204032 00000100:00100000:2.0:1787836517.462493:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172204032 00000100:00100000:2.0:1787836517.462561:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:2.0:1787836517.462582:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb9461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+15:10562:x1874682172204032:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787836517.462887:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836517.462919:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee032 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.462942:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:2.0:1787836517.462946:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836517.462977:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.462991:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.463001:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836517.464021:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000319a229b reply state 000000000ae74949 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.464038:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787836517.464210:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb9461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+16:10562:x1874682172204032:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 1638us (1844us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787836517.464229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:1.0:1787836517.472623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00010000:00010000:3.0:1787836517.473081:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.473097:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.473106:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.473112:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836517.473118:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.473126:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.473143:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:3.0:1787836517.473146:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836517.473152:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.473158:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7d3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.476708:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172204160 00000100:00100000:2.0:1787836517.476743:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172204160 00000100:00100000:1.0:1787836517.480901:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:1.0:1787836517.480916:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb946940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172204160:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787836517.481254:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787836517.481259:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787836516 -> 1787836515 00002000:00010000:1.0:1787836517.481262:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787836514 00002000:00010000:1.0:1787836517.481264:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787836516 -> 1787836515 00002000:00010000:1.0:1787836517.481266:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787836517.481349:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb946940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2361:x1874682172204160:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 433us (8738us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787836517.481373:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:0.0:1787836517.485696:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.485799:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172204416 00000100:00100000:2.0:1787836517.485811:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172204416 00000100:00100000:2.0:1787836517.485885:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:2.0:1787836517.485896:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+15:10562:x1874682172204416:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787836517.485974:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.485992:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.486002:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.486039:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.486053:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 15 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.486106:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874682193189760:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836517.486198:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836517.498247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.498428:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874682193189760:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836517.498467:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836517.498552:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172204544 00000100:00100000:0.0:1787836517.498559:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172204544 00010000:00010000:0.0:1787836517.498600:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 16 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836517.498651:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:0.0:1787836517.498662:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+16:2364:x1874682172204544:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836517.498678:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836517.498684:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 16 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.498696:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 16 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.498719:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee024 expref: 16 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.498735:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:0.0:1787836517.498739:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.498747:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.498787:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.498815:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836517.498879:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+15:2364:x1874682172204544:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 219us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836517.498887:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00010000:00010000:2.0:1787836517.499021:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.499039:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.499109:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.499116:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.499122:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.499127:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836517.499132:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.499139:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.499148:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:2.0:1787836517.499151:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787836517.499155:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.499160:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.499202:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10562:x1874682172204416:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 Request processed in 13309us (13522us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787836517.499219:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:3.0:1787836517.503471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.509523:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172204672 00000100:00100000:2.0:1787836517.509547:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172204672 00000100:00100000:2.0:1787836517.509642:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:2.0:1787836517.509655:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172204672:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787836517.509716:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.509738:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.509747:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836517.509751:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836517.509755:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.509799:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.509815:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 7 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.509832:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1874682193189888:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836517.509939:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836517.513280:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.513402:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172204800 00000100:00100000:0.0:1787836517.513413:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172204800 00010000:00010000:0.0:1787836517.513458:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 8 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836517.513503:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:0.0:1787836517.513514:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172204800:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836517.513531:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836517.513553:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 8 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.513569:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 8 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.513599:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787836517.513604:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787836517.513610:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.513633:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.513655:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836517.513721:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172204800:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 208us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836517.513728:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00010000:00010000:2.0:1787836517.513953:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab7d2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee040 expref: 7 pid: 6693 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.513970:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1874682193189888:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836517.514002:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514013:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514021:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514052:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514102:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514110:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514118:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005aa00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836517.514122:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514131:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514145:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.514160:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab7d4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.514230:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172204672:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 4579us (10774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.514240:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1787836517.521709:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.521877:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172205056 00000100:00100000:0.0:1787836517.521888:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172205056 00000100:00100000:0.0:1787836517.521951:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:0.0:1787836517.521962:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10562:x1874682172205056:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787836517.522051:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.522219:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.522232:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.527247:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.527276:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.527286:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.527328:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.527345:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 15 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836517.527360:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fb9452c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193190016:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836517.527462:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836517.535690:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fb9452c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193190016:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836517.535720:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836517.539822:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.543329:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172205184 00000100:00100000:0.0:1787836517.543351:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172205184 00010000:00010000:0.0:1787836517.543411:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 16 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836517.543469:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:0.0:1787836517.543479:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+16:2364:x1874682172205184:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836517.543516:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836517.543524:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 16 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.543539:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 16 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.543565:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee02b expref: 16 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.543599:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:0.0:1787836517.543606:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.543617:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.543626:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836517.543675:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836517.543734:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+15:2364:x1874682172205184:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 256us (3934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836517.543743:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00010000:00010000:3.0:1787836517.544117:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.544128:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787836517.544347:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787836517.544533:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787836517.544592:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787836517.544713:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a88000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1874682193190144:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787836517.544909:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836517.544952:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eeca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787836517.545979:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193190144 00000100:00100000:0.0:1787836517.546001:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193190144 00000100:00100000:0.0:1787836517.546122:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836517.546135:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874682193190144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787836517.546290:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874682193190144:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836517.546311:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787836517.550856:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787836517.550871:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1787836517.550893:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e3c1325e00, transno 4294967309 00000004:00080000:3.0:1787836517.550911:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e3c1326940, transno 4294967310 00000100:00100000:3.0:1787836517.550921:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a88000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1874682193190144:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787836517.551483:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1787836517.551586:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a88000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1874682193190272:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787836517.551656:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836517.551691:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eecb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787836517.554929:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193190272 00000100:00100000:0.0:1787836517.554942:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193190272 00000100:00100000:0.0:1787836517.554999:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787836517.555008:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1874682193190272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787836517.555278:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1874682193190272:12345-0@lo:1000:mdt00_001.0 Request processed in 271us (3621us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787836517.555287:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787836517.555610:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a88000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1874682193190272:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787836517.555666:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555679:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555687:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555694:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836517.555698:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555706:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555722:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:3.0:1787836517.555726:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836517.555731:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555737:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7d5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555779:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555786:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555792:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555808:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836517.555811:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555818:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555827:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836517.555829:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836517.555836:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee00f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555847:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee00f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555856:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee00f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.555888:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee00f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836517.555903:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a88f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193190400:192.168.203.25@tcp:105: 00000100:00100000:3.0:1787836517.555990:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787836517.563885:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a88f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193190400:192.168.203.25@tcp:105: 00010000:00010000:3.0:1787836517.563929:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.563961:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7c9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.563998:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564012:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564024:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564034:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564040:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564046:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564052:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ace00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836517.564055:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564090:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564103:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836517.564106:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836517.564110:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564122:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7d62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564134:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564140:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564146:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564151:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ee00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836517.564153:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564159:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564167:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836517.564170:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787836517.564172:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836517.564178:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ee00/0x966835ea68ab7d54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836517.564435:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+18:10562:x1874682172205056:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 42473us (42735us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787836517.564446:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 127 00000020:00080000:3.0:1787836517.564458:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787836517.564633:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787836517.564638:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787836517.565126:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787836517.565135:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787836517.565416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836517.567958:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172205312 00000100:00100000:0.0:1787836517.567975:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172205312 00000100:00100000:0.0:1787836517.568054:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:0.0:1787836517.568084:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+18:10559:x1874682172205312:12345-192.168.203.25@tcp:49:lfs.0 00000100:00100000:0.0:1787836517.568242:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+18:10559:x1874682172205312:12345-192.168.203.25@tcp:49:lfs.0 Request processed in 160us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836517.568249:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:3.0:1787836517.568704:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.568987:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172205568 00000100:00100000:2.0:1787836517.568994:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172205568 00000100:00100000:2.0:1787836517.569034:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:2.0:1787836517.569042:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93ce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+18:10562:x1874682172205568:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787836517.569945:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787836517.570095:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787836517.570157:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.570177:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.570192:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.570202:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.570218:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.570224:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.572625:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836517.572657:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.572672:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005aa00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836517.572677:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.572688:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.572734:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98e3d8034300) 00010000:00010000:1.0:1787836517.572737:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787836517.572743:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.572768:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836517.572771:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836517.572773:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836517.573480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836517.573987:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172205824 00000100:00100000:1.0:1787836517.574001:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172205824 00000100:00100000:1.0:1787836517.574119:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:1.0:1787836517.574131:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10559:x1874682172205824:12345-192.168.203.25@tcp:58:lfs.0 00000040:00080000:1.0:1787836517.574430:0:10086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787836517.574523:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10559:x1874682172205824:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 395us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836517.574532:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 128 00010000:00010000:2.0:1787836517.580628:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787836517.580656:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.583128:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836517.583301:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93ce450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+20:10562:x1874682172205568:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 14252us (14591us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787836517.583315:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000020:00080000:2.0:1787836517.583323:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787836517.653617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.653810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172205952 00000100:00100000:2.0:1787836517.653824:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172205952 00000100:00100000:2.0:1787836517.653902:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:2.0:1787836517.653913:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+20:10564:x1874682172205952:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836517.653946:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836517.653968:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee047 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654041:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654097:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654113:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654132:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654139:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654164:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654487:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654646:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654656:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654698:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.654715:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 21 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836517.654732:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193190528:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836517.654929:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40000 going to sleep for 11 seconds 00000100:00100000:0.0:1787836517.661613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.662604:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172206208 00000100:00100000:3.0:1787836517.662621:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172206208 00000100:00100000:3.0:1787836517.662700:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1787836517.662711:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+22:5599:x1874682172206208:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787836517.663002:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+23:5599:x1874682172206208:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 292us (1403us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787836517.663012:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1787836517.669464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.669733:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193190528:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836517.669783:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836517.670544:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172206336 00000100:00100000:1.0:1787836517.670553:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172206336 00010000:00010000:1.0:1787836517.670605:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 23 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836517.670645:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:1.0:1787836517.670654:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+23:2363:x1874682172206336:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836517.670670:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836517.670677:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 23 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.670718:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 23 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.670741:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7c90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee008 expref: 23 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.670767:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:1.0:1787836517.670772:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.670781:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.670789:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836517.670823:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836517.670905:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+22:2363:x1874682172206336:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 251us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836517.670913:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00010000:00010000:2.0:1787836517.672468:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.672505:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836517.672860:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787836517.672865:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836517.672891:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673023:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673039:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673046:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673053:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673099:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836517.673105:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673114:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673133:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836517.673137:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836517.673143:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673150:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7d77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673177:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673183:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673189:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673194:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836517.673197:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673203:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673220:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98e3d8034300) 00010000:00010000:2.0:1787836517.673223:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836517.673226:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673232:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7d7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673279:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7d70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee047 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673296:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee047 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836517.673318:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836517.673321:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836517.673323:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005ae00, rc 0) 00000100:00100000:2.0:1787836517.673409:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10564:x1874682172205952:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 19497us (19803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.673418:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:3.0:1787836517.995943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.996117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.996152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.996188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836517.996221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836517.997742:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172206976 00000100:00100000:2.0:1787836517.997756:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172206976 00000100:00100000:2.0:1787836517.997845:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172206592 00000100:00100000:2.0:1787836517.997850:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172206592 00000100:00100000:2.0:1787836517.997893:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 146 00000100:00100000:2.0:1787836517.997904:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172206976:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836517.997992:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2364:x1874682172206976:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 91us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.998001:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 146 00000100:00100000:2.0:1787836517.998022:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 147 00000100:00100000:2.0:1787836517.998030:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+21:2363:x1874682172206592:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836517.998086:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+21:2363:x1874682172206592:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 30us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.998092:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 147 00000100:00100000:2.0:1787836517.998118:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172206720 00000100:00100000:2.0:1787836517.998122:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172206720 00000100:00100000:2.0:1787836517.998159:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172206848 00000100:00100000:2.0:1787836517.998162:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172206848 00000100:00100000:2.0:1787836517.998185:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:2.0:1787836517.998222:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172206720:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836517.998252:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172206720:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 45us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.998258:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:2.0:1787836517.998271:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:2.0:1787836517.998277:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172206848:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836517.998301:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172206848:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836517.998307:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:0.0:1787836517.999664:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172206464 00000100:00100000:0.0:1787836517.999676:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172206464 00000100:00080000:3.0:1787836517.999976:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787836517.999984:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836518.000788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 294 00000100:00100000:2.0:1787836518.000803:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172206464:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836518.000903:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172206464:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 103us (4972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836518.000911:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 294 00010000:00010000:0.0:1787836518.574438:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787836518.574614:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836518.574621:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836518.574664:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787836518.574673:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787836518.575388:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fb946d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193190656:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787836518.575534:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f50b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787836518.590218:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fb946d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193190656:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787836518.591494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836518.591580:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172207104 00000100:00100000:3.0:1787836518.591592:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172207104 00000100:00100000:3.0:1787836518.591689:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:3.0:1787836518.591701:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb946d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10575:x1874682172207104:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787836518.591766:0:10086:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787836518.591917:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb946d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10575:x1874682172207104:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 218us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836518.591935:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00080000:0.0:1787836518.592959:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836518.595403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836518.595477:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172207360 00000100:00100000:1.0:1787836518.595487:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172207360 00000100:00100000:1.0:1787836518.595550:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:1.0:1787836518.595562:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+21:10575:x1874682172207360:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836518.595587:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836518.595611:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7d8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee04e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836518.595725:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836518.595740:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836518.595765:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836518.595777:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787836518.596240:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7d8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee04e expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836518.596260:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee04e expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836518.596269:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:1.0:1787836518.596272:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836518.596275:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4e00, rc 0) 00000100:00100000:1.0:1787836518.596340:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+23:10575:x1874682172207360:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 781us (947us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787836518.596362:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:3.0:1787836518.600337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836518.600416:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172207616 00000100:00100000:0.0:1787836518.600427:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172207616 00000100:00100000:0.0:1787836518.600495:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:0.0:1787836518.600522:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+23:10575:x1874682172207616:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787836518.600614:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.600632:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.600644:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.601229:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.601239:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.601246:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.601253:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3fe00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836518.601258:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.601266:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.601280:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:0.0:1787836518.601283:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787836518.601289:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836518.601295:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab7da1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836518.601477:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+24:10575:x1874682172207616:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 956us (1151us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787836518.601486:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 132 00000040:00080000:1.0:1787836518.602121:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836518.602128:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836518.602636:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787836518.602648:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787836518.608170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836518.608264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836518.608524:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172208000 00000100:00100000:2.0:1787836518.608536:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172208000 00000100:00100000:2.0:1787836518.608603:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:2.0:1787836518.608614:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb945a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+24:10575:x1874682172208000:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787836518.609031:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb945a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+25:10575:x1874682172208000:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 417us (765us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787836518.609040:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:3.0:1787836518.609601:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172207744 00000100:00100000:3.0:1787836518.609607:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172207744 00000100:00100000:3.0:1787836518.609665:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:3.0:1787836518.609675:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb945e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+25:2363:x1874682172207744:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836518.609689:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836518.609719:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee04e expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836518.609739:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836518.609754:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836518.609794:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb945e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+24:2363:x1874682172207744:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 121us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836518.609800:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000040:00080000:2.0:1787836518.665359:0:12060:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787836518.665372:0:12060:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787836518.665422:0:12060:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787836518.665437:0:12060:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787836518.926655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836518.927910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172208256 00000100:00100000:3.0:1787836518.927926:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172208256 00000100:00100000:3.0:1787836518.930668:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:3.0:1787836518.930688:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+24:10588:x1874682172208256:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836518.930728:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836518.930748:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7da8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee055 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836518.930860:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7daf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836518.930887:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7daf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836518.930899:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7daf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836518.930917:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787836518.931127:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7da8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee055 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836518.931155:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7daf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee055 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836518.931164:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:3.0:1787836518.931167:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787836518.931170:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad800, rc 0) 00000100:00100000:3.0:1787836518.931253:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+26:10588:x1874682172208256:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 572us (4609us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787836518.931262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:3.0:1787836518.940540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836518.940620:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172208384 00000100:00100000:2.0:1787836518.940631:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172208384 00000100:00100000:2.0:1787836518.940688:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:2.0:1787836518.940705:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+26:10588:x1874682172208384:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:2.0:1787836518.940791:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940813:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940827:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940866:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940874:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940883:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940891:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836518.940896:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940905:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940921:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836518.940944:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836518.940952:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836518.940960:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836518.943445:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+26:10588:x1874682172208384:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 2726us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836518.943465:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:2.0:1787836519.056997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836519.057410:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172208512 00000100:00100000:0.0:1787836519.057422:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172208512 00000100:00100000:0.0:1787836519.057560:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:0.0:1787836519.057574:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172208512:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:0.0:1787836519.057599:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836519.057628:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb13803f/0x966835ea68ab7dc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee05c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787836519.057671:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a903863, atime: 0x6a903862, ctime: 0x6a903863, blocks: 0xb 00010000:00010000:0.0:1787836519.057712:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1787836519.057718:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836519.057732:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb13803f/0x966835ea68ab7dc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee05c expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836519.057756:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb13803f/0x966835ea68ab7dc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee05c expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836519.057772:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3ee00, rc 0) 00000100:00100000:0.0:1787836519.058027:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172208512:12345-192.168.203.25@tcp:101:cat.0 Request processed in 457us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836519.058037:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00080000:3.0:1787836519.062274:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836519.078174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836519.078277:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172208640 00000100:00100000:2.0:1787836519.078289:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172208640 00002000:00100000:2.0:1787836519.078350:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff98e3f5a88f00 x1874682172208640/t0(0) o3->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:305/0 lens 488/0 e 0 to 0 dl 1787836530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836519.078361:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3f5a88f00 with x1874682172208640 ext(0->4095) 00002000:00010000:2.0:1787836519.078367:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e3f5a88f00 00000100:00100000:2.0:1787836519.078399:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:2.0:1787836519.078409:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172208640:12345-192.168.203.25@tcp:3:cat.0 00000100:00100000:2.0:1787836519.078706:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172208640:12345-192.168.203.25@tcp:3:cat.0 Request processed in 297us (542us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787836519.078714:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00002000:00100000:2.0:1787836519.078722:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff98e3f5a88f00 x1874682172208640/t0(0) o3->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:305/0 lens 488/4536 e 0 to 0 dl 1787836530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836519.078730:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3f5a88f00 with x1874682172208640 ext(0->4095) 00002000:00010000:2.0:1787836519.078734:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e3f5a88f00 00010000:00010000:1.0:1787836519.598708:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836520.176221:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193191040:0@lo:400:kworker.0 00000100:00100000:2.0:1787836520.176303:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836520.176379:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836520.176393:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193191168:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.176565:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193190784:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.176597:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836520.176618:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193191296:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.176635:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836520.176651:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787836520.176655:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193190912:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.176670:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836520.176685:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193191424:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.176702:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836520.176726:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193190784 00000100:00100000:1.0:1787836520.176732:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193190784 00000100:00100000:1.0:1787836520.176777:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787836520.176785:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193190784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.176831:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193190784:12345-0@lo:400:kworker.0 Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836520.176837:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787836520.176865:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193191040 00000100:00100000:1.0:1787836520.176874:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193191040 00000100:00100000:1.0:1787836520.176923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193191296 00000100:00100000:1.0:1787836520.176926:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193191296 00000100:00100000:1.0:1787836520.176940:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193190912 00000100:00100000:1.0:1787836520.176942:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193190912 00000100:00100000:1.0:1787836520.176952:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787836520.176958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193191040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.176986:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193191040:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836520.176991:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787836520.177001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787836520.177006:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb9470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193191296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.177025:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb9470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193191296:12345-0@lo:400:kworker.0 Request processed in 20us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836520.177031:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787836520.177040:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787836520.177044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb946580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193190912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.177087:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb946580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193190912:12345-0@lo:400:kworker.0 Request processed in 42us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836520.177093:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787836520.177107:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193191424 00000100:00100000:1.0:1787836520.177110:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193191424 00000100:00100000:1.0:1787836520.177132:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787836520.177137:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb947c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193191424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.177165:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb947c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193191424:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836520.177170:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787836520.177203:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836520.177207:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836520.177241:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193190912:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.177251:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193191424:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.177258:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193190784:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.177266:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193191296:0@lo:400:kworker.0 00000100:00100000:2.0:1787836520.177358:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836520.177398:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193191040:0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.180617:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193191168 00000100:00100000:1.0:1787836520.180635:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193191168 00000100:00100000:1.0:1787836520.180736:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787836520.180751:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193191168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836520.180863:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193191168:12345-0@lo:400:kworker.0 Request processed in 116us (3503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836520.180871:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787836520.180938:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193191168:0@lo:400:kworker.0 00000100:00080000:0.0:1787836520.181023:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787836520.630252:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836520.691318:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836520.691350:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193191552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836520.691431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836520.691567:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193191552 00000100:00100000:1.0:1787836520.691576:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193191552 00000100:00100000:1.0:1787836520.691640:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787836520.691650:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193191552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787836520.691686:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836520.691738:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193191552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836520.691745:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787836520.691791:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193191552:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787836521.244383:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:0.0:1787836521.646437:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836522.230998:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836522.231025:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193191680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836522.231124:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836522.231203:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193191680 00000100:00100000:0.0:1787836522.231210:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193191680 00000100:00100000:0.0:1787836522.231277:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787836522.231287:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3faa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193191680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836522.231328:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836522.231386:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3faa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193191680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836522.231394:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787836522.235396:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836522.235468:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193191680:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787836522.314158:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1787836522.314173:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1787836522.318406:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:0.0:1787836522.318427:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787836522.318440:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e2c3eeca80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787836522.318446:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3e8bcbe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e2c3eec780 00000020:00080000:0.0:1787836522.318449:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3e8bcb400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e3c6159800 00000020:00080000:0.0:1787836522.318465:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:3.0:1787836522.318587:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787836522.318969:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787836522.673544:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787836522.832340:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787836522.832359:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:1.0:1787836523.120401:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836523.120442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836523.120467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836523.120486:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836523.120507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836523.120551:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172209024 00000100:00100000:1.0:1787836523.120561:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172209024 00000100:00100000:1.0:1787836523.120621:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172209152 00000100:00100000:1.0:1787836523.120624:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172209152 00000100:00100000:1.0:1787836523.120655:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:1.0:1787836523.120669:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb947840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172209024:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836523.120944:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172208768 00000100:00100000:3.0:1787836523.120953:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172208768 00000100:00100000:3.0:1787836523.120994:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 296 00000100:00100000:3.0:1787836523.121014:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172208768:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836523.121099:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172208768:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 87us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836523.121108:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 296 00000100:00100000:1.0:1787836523.121674:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb947840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2361:x1874682172209024:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 1007us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836523.121684:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:1.0:1787836523.121705:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:1.0:1787836523.121778:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb944780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172209152:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836523.121809:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb944780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172209152:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 98us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836523.121816:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:1.0:1787836523.121839:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172209280 00000100:00100000:1.0:1787836523.121844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172209280 00000100:00100000:1.0:1787836523.121881:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172208896 00000100:00100000:1.0:1787836523.121883:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172208896 00000100:00100000:1.0:1787836523.121903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 151 00000100:00100000:1.0:1787836523.121909:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172209280:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836523.121952:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172209280:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 43us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836523.121959:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 151 00000100:00100000:1.0:1787836523.121972:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 152 00000100:00100000:1.0:1787836523.121979:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:2361:x1874682172208896:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836523.122002:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:2361:x1874682172208896:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836523.122008:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 152 00000100:00080000:1.0:1787836523.122032:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787836523.122036:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836523.122039:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787836523.695867:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787836523.758362:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836523.758374:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836523.758460:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787836523.758472:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787836524.718453:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836525.068111:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836525.072759:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172209408 00000100:00100000:2.0:1787836525.072781:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172209408 00000100:00080000:1.0:1787836525.073204:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836525.073221:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 135 00000100:00100000:3.0:1787836525.073239:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb944f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:10248:x1874682172209408:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787836525.073726:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb944f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:10248:x1874682172209408:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 Request processed in 491us (5675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836525.073736:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 135 00000100:00100000:3.0:1787836525.075945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836525.076217:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172209664 00000100:00100000:1.0:1787836525.076227:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172209664 00000100:00100000:1.0:1787836525.076289:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:1.0:1787836525.076299:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1327840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+13:10248:x1874682172209664:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787836525.077134:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1327840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+14:10248:x1874682172209664:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 831us (1197us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787836525.077144:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:1.0:1787836525.294679:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeace580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193192192:0@lo:400:kworker.0 00000100:00100000:1.0:1787836525.294776:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836525.294845:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836525.294852:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeacda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193192064:0@lo:400:kworker.0 00000100:00100000:1.0:1787836525.294878:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836525.294906:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193192192 00000100:00100000:1.0:1787836525.294915:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193192192 00000100:00100000:3.0:1787836525.295081:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193192064 00000100:00100000:3.0:1787836525.295086:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193192064 00000100:00100000:3.0:1787836525.295122:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787836525.295141:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193192064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836525.295220:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193192064:12345-0@lo:400:kworker.0 Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836525.295227:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1787836525.295262:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787836525.295266:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836525.295739:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fb944b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193191936:0@lo:400:kworker.0 00000100:00100000:2.0:1787836525.295779:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836525.295811:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193192448:0@lo:400:kworker.0 00000100:00100000:2.0:1787836525.295835:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836525.295876:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193191936 00000100:00100000:3.0:1787836525.295882:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193191936 00000100:00100000:3.0:1787836525.295912:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787836525.295919:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c82883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193191936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836525.295955:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c82883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193191936:12345-0@lo:400:kworker.0 Request processed in 37us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836525.295994:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787836525.296079:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeacda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193192064:0@lo:400:kworker.0 00000100:00100000:0.0:1787836525.297363:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fb9452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193191808:0@lo:400:kworker.0 00000100:00100000:0.0:1787836525.297450:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836525.297502:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeacf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193192320:0@lo:400:kworker.0 00000100:00100000:0.0:1787836525.297548:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836525.297596:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193191808 00000100:00100000:0.0:1787836525.297602:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193191808 00000100:00100000:0.0:1787836525.297642:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787836525.297651:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193191808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836525.297696:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193191808:12345-0@lo:400:kworker.0 Request processed in 46us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836525.297702:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787836525.297735:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193192320 00000100:00100000:0.0:1787836525.297739:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193192320 00000100:00100000:0.0:1787836525.297776:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787836525.297782:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193192320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836525.297811:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193192320:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836525.297817:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1787836525.297832:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836525.297860:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fb9452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193191808:0@lo:400:kworker.0 00000100:00100000:0.0:1787836525.297873:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeacf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193192320:0@lo:400:kworker.0 00000100:00100000:2.0:1787836525.299736:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fb944b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193191936:0@lo:400:kworker.0 00000100:00100000:1.0:1787836525.300816:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193192448 00000100:00100000:1.0:1787836525.300827:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193192448 00000100:00100000:0.0:1787836525.300873:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1787836525.300923:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836525.301610:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787836525.301624:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193192448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836525.301763:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193192448:12345-0@lo:400:kworker.0 Request processed in 144us (5926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836525.301771:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787836525.301969:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787836525.301978:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e401fd5680, transno 4294967304 00000100:00100000:3.0:1787836525.301998:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193192448:0@lo:400:kworker.0 00000100:00100000:0.0:1787836525.307608:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193192192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836525.308165:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787836525.308173:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1787836525.308293:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193192192:12345-0@lo:400:kworker.0 Request processed in 7406us (13513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836525.308305:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787836525.308396:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeace580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193192192:0@lo:400:kworker.0 00000100:00100000:0.0:1787836525.525484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836525.527138:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172209792 00000100:00100000:3.0:1787836525.527162:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172209792 00000100:00100000:3.0:1787836525.527290:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 136 00000100:00100000:3.0:1787836525.527305:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:11041:x1874682172209792:12345-192.168.203.25@tcp:101:lsof.0 00010000:00010000:3.0:1787836525.527336:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836525.527368:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7dcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee063 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836525.527828:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836525.527849:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836525.527862:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836525.528200:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787836525.528212:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:2.0:1787836525.528338:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1787836525.529623:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836525.529677:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7dcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836525.529700:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836525.529709:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:3.0:1787836525.529712:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787836525.529717:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac800, rc 0) 00000100:00100000:3.0:1787836525.529801:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:11041:x1874682172209792:12345-192.168.203.25@tcp:101:lsof.0 Request processed in 2502us (4330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836525.529811:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 136 00010000:00010000:1.0:1787836525.742335:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836525.807866:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c8288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193192576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787836525.807960:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836525.808293:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193192576 00000100:00100000:2.0:1787836525.808303:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193192576 00000100:00100000:2.0:1787836525.808364:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787836525.808375:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193192576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836525.808410:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836525.808466:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193192576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836525.808474:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787836525.808776:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c8288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193192576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787836526.766495:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836527.342637:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193192704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836527.342724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836527.344812:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193192704 00000100:00100000:2.0:1787836527.344824:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193192704 00000100:00100000:2.0:1787836527.344889:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787836527.344900:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1324f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193192704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836527.344938:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836527.345020:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1324f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193192704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836527.345027:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787836527.345053:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836527.345128:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193192704:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787836527.443832:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787836527.446515:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787836527.446589:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787836527.446601:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787836527.791926:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836528.234177:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836528.234221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836528.234258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836528.234293:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836528.234334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836528.234365:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172210048 00000100:00100000:0.0:1787836528.234376:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172210048 00000100:00100000:0.0:1787836528.234433:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172210432 00000100:00100000:0.0:1787836528.234437:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172210432 00000100:00100000:0.0:1787836528.234458:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 156 00000100:00100000:0.0:1787836528.234467:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+13:2362:x1874682172210048:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836528.234557:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+13:2362:x1874682172210048:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836528.234565:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 156 00000100:00100000:0.0:1787836528.234739:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 157 00000100:00100000:0.0:1787836528.234748:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb944b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2361:x1874682172210432:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836528.234778:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb944b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2361:x1874682172210432:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836528.234831:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172210176 00000100:00100000:1.0:1787836528.234837:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172210176 00000100:00100000:1.0:1787836528.234882:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172210304 00000100:00100000:1.0:1787836528.234887:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172210304 00000100:00100000:1.0:1787836528.234914:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:1.0:1787836528.234921:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172210176:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836528.234950:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172210176:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 30us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836528.234957:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:1.0:1787836528.234973:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:1.0:1787836528.234979:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172210304:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836528.235003:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172210304:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836528.235024:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00080000:1.0:1787836528.235268:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836528.235273:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836528.235275:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836528.237394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172209920 00000100:00100000:3.0:1787836528.237410:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172209920 00000100:00100000:3.0:1787836528.237468:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 298 00000100:00100000:3.0:1787836528.237477:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172209920:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836528.237573:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172209920:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 97us (3407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836528.237581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 298 00000100:00100000:0.0:1787836528.240538:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 157 00010000:00010000:1.0:1787836528.817106:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836529.839783:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836530.162532:0:12264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:15:27 (1787836527) 00000100:00100000:3.0:1787836530.417445:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787836530.417532:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836530.417556:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c8288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193192960:0@lo:400:kworker.0 00000100:00100000:0.0:1787836530.417636:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836530.417828:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193192960 00000100:00100000:1.0:1787836530.417835:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193192960 00000100:00100000:1.0:1787836530.417898:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787836530.417909:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb9452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193192960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836530.417969:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb9452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193192960:12345-0@lo:400:kworker.0 Request processed in 63us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836530.417977:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787836530.418095:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c8288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193192960:0@lo:400:kworker.0 00000100:00100000:3.0:1787836530.420453:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c828b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193192832:0@lo:400:kworker.0 00000100:00100000:3.0:1787836530.420670:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836530.420747:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193192832 00000100:00100000:0.0:1787836530.420774:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193192832 00000100:00100000:0.0:1787836530.420851:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787836530.420861:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193192832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836530.422744:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c8288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193193088:0@lo:400:kworker.0 00000100:00100000:2.0:1787836530.422809:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836530.422858:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836530.422864:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193193216:0@lo:400:kworker.0 00000100:00100000:2.0:1787836530.422890:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836530.422923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193193088 00000100:00100000:2.0:1787836530.422930:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193193088 00000100:00100000:2.0:1787836530.422980:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787836530.422989:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193193088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836530.423040:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193193088:12345-0@lo:400:kworker.0 Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836530.423046:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787836530.423094:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193193216 00000100:00100000:2.0:1787836530.423098:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193193216 00000100:00100000:2.0:1787836530.423135:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787836530.423142:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193193216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836530.423187:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193193216:12345-0@lo:400:kworker.0 Request processed in 47us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836530.423193:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787836530.423209:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787836530.423213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836530.423247:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193193216:0@lo:400:kworker.0 00000100:00100000:2.0:1787836530.423258:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c8288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193193088:0@lo:400:kworker.0 00000100:00100000:1.0:1787836530.423353:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193193344:0@lo:400:kworker.0 00000100:00100000:1.0:1787836530.423382:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836530.423416:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836530.423422:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c615d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193193472:0@lo:400:kworker.0 00000100:00100000:1.0:1787836530.423443:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836530.423468:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193193472 00000100:00100000:1.0:1787836530.423472:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193193472 00000100:00100000:1.0:1787836530.423516:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787836530.423522:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193193472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836530.423556:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193193472:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836530.423562:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787836530.423586:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193193472:0@lo:400:kworker.0 00000100:00080000:2.0:1787836530.423693:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836530.423704:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193193344 00000100:00100000:2.0:1787836530.423708:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193193344 00000100:00100000:2.0:1787836530.423749:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787836530.423756:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193193344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836530.423790:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193193344:12345-0@lo:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836530.423796:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787836530.423849:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836530.423874:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c615da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193193344:0@lo:400:kworker.0 00000100:00100000:0.0:1787836530.424806:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193192832:12345-0@lo:400:kworker.0 Request processed in 3941us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836530.424817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787836530.426769:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c828b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193192832:0@lo:400:kworker.0 00010000:00010000:0.0:1787836530.864105:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836530.926793:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5dc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193193600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836530.926895:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836530.927046:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193193600 00000100:00100000:1.0:1787836530.927081:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193193600 00000100:00100000:1.0:1787836530.927152:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787836530.927162:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193193600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787836530.927206:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836530.931667:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193193600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4495us (4761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836530.931682:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787836530.932592:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5dc12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193193600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836531.816305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836531.816493:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172210688 00000100:00100000:2.0:1787836531.816516:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172210688 00000100:00100000:2.0:1787836531.816666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00100000:2.0:1787836531.816678:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+13:11307:x1874682172210688:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836531.816702:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836531.816724:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7dd9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee06a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.816808:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.816821:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.816848:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.816864:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.816871:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.816877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817381:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7dee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817392:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7dee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817400:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7dee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836531.817409:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787836531.817625:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817632:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817639:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817645:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836531.817656:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817664:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817676:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e3d81a4300) 00010000:00010000:2.0:1787836531.817679:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836531.817684:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817691:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7de0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817705:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817711:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817717:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817721:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836531.817724:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817729:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817737:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98e3d8034400) 00010000:00010000:2.0:1787836531.817739:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836531.817747:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.817754:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7de7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.818221:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7dd9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee06a expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.818238:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7dee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee06a expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836531.818245:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:2.0:1787836531.818247:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836531.818250:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836531.818321:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+15:11307:x1874682172210688:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1645us (2030us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787836531.818329:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00080000:1.0:1787836531.822037:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836531.834317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836531.834476:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172210816 00000100:00100000:2.0:1787836531.834487:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172210816 00000100:00100000:2.0:1787836531.834572:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:2.0:1787836531.834581:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1326940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+15:11307:x1874682172210816:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787836531.834703:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1326940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+15:11307:x1874682172210816:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 124us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836531.834711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:2.0:1787836531.847315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836531.847563:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172210944 00000100:00100000:1.0:1787836531.847575:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172210944 00000100:00100000:1.0:1787836531.847656:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:1.0:1787836531.847666:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+15:2361:x1874682172210944:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836531.847682:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836531.847707:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab7dee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee06a expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836531.847728:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:1.0:1787836531.847733:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836531.849423:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+14:2361:x1874682172210944:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1744us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836531.849440:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00010000:00010000:0.0:1787836531.897904:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787836531.950491:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836531.950504:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836531.951464:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787836531.951483:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787836532.475645:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193193728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836532.475733:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836532.475808:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193193728 00000100:00100000:0.0:1787836532.475815:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193193728 00000100:00100000:0.0:1787836532.475872:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787836532.475881:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193193728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836532.475917:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836532.475955:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193193728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836532.475962:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787836532.475980:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836532.476010:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193193728:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787836532.544533:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:2.0:1787836532.914817:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836533.362942:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836533.362994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836533.363025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836533.363050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836533.363137:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172211072 00000100:00100000:3.0:1787836533.363150:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172211072 00000100:00100000:2.0:1787836533.363322:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172211328 00000100:00100000:2.0:1787836533.363338:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172211328 00000100:00100000:2.0:1787836533.363469:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 95 00000100:00100000:2.0:1787836533.363481:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172211328:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836533.363561:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172211328:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 84us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836533.363569:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 95 00000100:00080000:2.0:1787836533.363602:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836533.363797:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 300 00000100:00100000:3.0:1787836533.363815:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172211072:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836533.363869:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172211072:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 61us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836533.363876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 300 00000100:00100000:0.0:1787836533.367202:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172211584 00000100:00100000:0.0:1787836533.367239:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172211584 00000100:00100000:0.0:1787836533.367335:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172211200 00000100:00100000:0.0:1787836533.367339:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172211200 00000100:00100000:0.0:1787836533.367369:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 161 00000100:00100000:0.0:1787836533.367379:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb945680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2364:x1874682172211584:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836533.367460:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb945680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2364:x1874682172211584:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 83us (4434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836533.367467:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 161 00000100:00100000:0.0:1787836533.367484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 162 00000100:00100000:0.0:1787836533.367491:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb945e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+13:2364:x1874682172211200:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836533.367517:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb945e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+13:2364:x1874682172211200:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (4466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836533.367524:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 162 00000100:00080000:3.0:1787836533.367528:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836533.367963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836533.368207:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172211456 00000100:00100000:0.0:1787836533.368213:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172211456 00000100:00100000:0.0:1787836533.368262:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 96 00000100:00100000:0.0:1787836533.368270:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172211456:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836533.368315:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172211456:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 45us (353us total) trans 0 rc 0/0 00000100:00080000:3.0:1787836533.368317:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787836533.368325:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 96 00010000:00010000:0.0:1787836533.941594:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787836534.013242:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787836534.013251:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787836534.013748:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787836534.013756:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787836534.570395:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836534.570501:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172211712 00000100:00100000:2.0:1787836534.570514:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172211712 00000100:00100000:2.0:1787836534.570580:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:2.0:1787836534.570589:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+13:11349:x1874682172211712:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836534.570611:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836534.570655:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee071 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.570738:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.570753:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.570768:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.570783:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.570791:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.570819:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571881:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571895:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571902:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571909:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836534.571914:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571922:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571937:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:2.0:1787836534.571940:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836534.571946:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571953:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab7e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571962:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571968:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571980:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571985:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836534.571988:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.571995:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.572003:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98e3d8034400) 00010000:00010000:2.0:1787836534.572006:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836534.572009:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.572014:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab7e0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.572326:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dfc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee071 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.572339:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:2.0:1787836534.572342:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836534.572347:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab7dfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee071 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836534.572359:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836534.572575:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+13:11349:x1874682172211712:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1983us (2188us total) trans 0 rc 301/301 00000100:00100000:2.0:1787836534.572595:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:3.0:1787836534.587978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836534.588103:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172211968 00000100:00100000:0.0:1787836534.588125:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172211968 00000100:00100000:0.0:1787836534.588181:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 140 00000100:00100000:0.0:1787836534.588191:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+13:11349:x1874682172211968:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:0.0:1787836534.588256:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836534.588283:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab777a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeaa expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.588304:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:0.0:1787836534.588309:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836534.588589:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.588605:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.588615:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.588915:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.588932:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 5 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836534.588947:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae830c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193193856:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836534.589042:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8163240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836534.599796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836534.602290:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172212096 00000100:00100000:3.0:1787836534.602307:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172212096 00010000:00010000:3.0:1787836534.602374:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 6 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836534.602423:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:3.0:1787836534.602447:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2364:x1874682172212096:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836534.602473:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836534.602481:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 6 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602494:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 6 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602516:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:3.0:1787836534.602521:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602530:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602538:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602556:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836534.602617:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2364:x1874682172212096:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 172us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836534.602769:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00010000:00010000:3.0:1787836534.602832:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7dd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee063 expref: 5 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836534.602848:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae830c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193193856:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836534.602870:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602891:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602897:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602925:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602936:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.602943:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836534.604940:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787836534.604958:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.604969:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.604976:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.604982:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836534.604987:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.604995:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.605021:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431e00) 00010000:00010000:3.0:1787836534.605024:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836534.605029:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.605035:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e11 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787836534.605053:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055c2c80f reply state 00000000ac6acd3a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836534.605107:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787836534.605208:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+14:11349:x1874682172211968:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 17013us (17235us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787836534.605217:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 140 00010000:00010000:3.0:1787836534.608929:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.608947:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.608955:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.608962:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836534.608967:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.608975:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.609012:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98e3d224ad00) 00010000:00010000:3.0:1787836534.609016:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836534.609021:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.609028:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e18 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836534.766591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836534.766720:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172212224 00000100:00100000:0.0:1787836534.766746:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172212224 00000100:00100000:0.0:1787836534.766844:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 141 00000100:00100000:0.0:1787836534.766854:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+13:11357:x1874682172212224:12345-192.168.203.25@tcp:101:lctl.0 00010000:00010000:0.0:1787836534.766880:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836534.766905:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee078 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.766975:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7e26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.766988:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.766999:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836534.767101:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787836534.767106:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836534.767137:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.767166:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee078 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.767184:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee078 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.767338:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:0.0:1787836534.767341:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836534.767345:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3fc00, rc 0) 00000100:00100000:0.0:1787836534.767414:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+14:11357:x1874682172212224:12345-192.168.203.25@tcp:101:lctl.0 Request processed in 561us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836534.767422:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 141 00000100:00100000:1.0:1787836534.859378:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836534.860178:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172212352 00000100:00100000:3.0:1787836534.860191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172212352 00000100:00100000:3.0:1787836534.860267:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 142 00000100:00100000:3.0:1787836534.860279:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+14:11363:x1874682172212352:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836534.860306:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836534.860329:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee07f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860401:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860416:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860428:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860442:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860450:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860475:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860660:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7e42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860670:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860677:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836534.860711:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787836534.860715:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836534.860738:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860750:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860756:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860762:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860768:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836534.860772:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860779:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860799:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:3.0:1787836534.860802:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836534.860806:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860813:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab7e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860830:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860835:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860841:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860845:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ace00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836534.860848:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860854:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860860:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98e3d224ad00) 00010000:00010000:3.0:1787836534.860862:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836534.860865:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860870:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab7e3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860920:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab7e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee07f expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860935:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee07f expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.860942:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836534.860955:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787836534.860958:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ad200, rc 0) 00000100:00100000:3.0:1787836534.861035:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+15:11363:x1874682172212352:12345-192.168.203.25@tcp:101:bash.0 Request processed in 759us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836534.861044:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 142 00000100:00100000:2.0:1787836534.863967:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836534.864170:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172212608 00000100:00100000:3.0:1787836534.864181:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172212608 00000100:00100000:3.0:1787836534.864236:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:3.0:1787836534.864247:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+15:11363:x1874682172212608:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836534.864269:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836534.864292:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab7e49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee086 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.864456:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.864473:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.864487:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.864524:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.864532:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.864538:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787836534.867570:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787836534.868289:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868309:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868321:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868363:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868371:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868378:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868385:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836534.868390:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868418:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868434:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836534.868437:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836534.868442:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868448:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab7e50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787836534.868464:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037ab2e27 reply state 0000000022e989cb transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836534.868473:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787836534.868516:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab7e49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868533:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.868540:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d224ad00) 00010000:00010000:3.0:1787836534.868541:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836534.868544:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a000, rc 0) 00000100:00100000:3.0:1787836534.868959:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11363:x1874682172212608:12345-192.168.203.25@tcp:101:bash.0 Request processed in 4711us (5015us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787836534.868968:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 143 00010000:00010000:3.0:1787836534.872918:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.872955:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.872962:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.872967:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836534.872971:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.872979:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.872995:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d224a000) 00010000:00010000:3.0:1787836534.872998:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836534.873002:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836534.873008:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836534.880273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836534.880414:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172212736 00000100:00100000:1.0:1787836534.880427:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172212736 00000100:00100000:1.0:1787836534.880496:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:1.0:1787836534.880509:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172212736:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836534.880532:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836534.880557:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee08d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787836534.880602:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787836534.880637:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787836534.880642:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836534.880655:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836534.880676:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836534.880690:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4000, rc 0) 00000100:00100000:1.0:1787836534.880754:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172212736:12345-192.168.203.25@tcp:101:bash.0 Request processed in 248us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836534.880778:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:2.0:1787836534.886696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836534.886996:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172212864 00000100:00100000:1.0:1787836534.887008:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172212864 00000100:00100000:1.0:1787836534.887111:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:1.0:1787836534.887123:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:11363:x1874682172212864:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836534.887469:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836534.887491:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee094 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836534.887525:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836534.887535:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836534.887539:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836534.887545:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836534.887742:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836534.887757:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 7 pid: 6691 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836534.887771:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1874682193193984:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836534.887930:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0500780 going to sleep for 11 seconds 00000100:00100000:1.0:1787836534.899253:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1874682193193984:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836534.899306:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836534.899336:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5a00, rc 0) 00000100:00100000:1.0:1787836534.899416:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:11363:x1874682172212864:12345-192.168.203.25@tcp:101:bash.0 Request processed in 12295us (12730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836534.899427:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:2.0:1787836534.900324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836534.900399:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172212992 00000100:00100000:0.0:1787836534.900408:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172212992 00010000:00010000:0.0:1787836534.900448:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 7 pid: 6691 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836534.900492:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:0.0:1787836534.900502:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172212992:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836534.900519:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836534.900550:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 7 pid: 6691 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.900578:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 7 pid: 6691 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.900609:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bffc25d5/0x966835ea68ab7e6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee08d expref: 7 pid: 6691 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.900644:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836534.900651:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836534.900661:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.900671:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836534.900728:0:7632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836534.900743:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d144a1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7632:1874682193194112:192.168.203.25@tcp:105: 00000100:00100000:0.0:1787836534.900838:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d81630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836534.906510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836534.906908:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d144a1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7632:1874682193194112:192.168.203.25@tcp:105: 00010000:00010000:0.0:1787836534.906944:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836534.907007:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2363:x1874682172212992:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 6506us (6691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836534.907020:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:1.0:1787836534.907186:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172213248 00000100:00100000:1.0:1787836534.907192:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172213248 00000100:00100000:1.0:1787836534.907252:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:1.0:1787836534.907261:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11363:x1874682172213248:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:1.0:1787836534.907835:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11363:x1874682172213248:12345-192.168.203.25@tcp:35:bash.0 Request processed in 573us (1337us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787836534.907843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00010000:00010000:0.0:1787836534.958584:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836535.009388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836535.010262:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172213504 00000100:00100000:3.0:1787836535.010273:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172213504 00000100:00100000:3.0:1787836535.010357:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 144 00000100:00100000:3.0:1787836535.010369:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11373:x1874682172213504:12345-192.168.203.25@tcp:101:lfs.0 00000100:00080000:2.0:1787836535.010375:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787836535.010391:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836535.010413:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee09b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836535.010543:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787836535.010674:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee09b expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.010687:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:3.0:1787836535.010690:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787836535.010695:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee09b expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.010709:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a800, rc 0) 00000100:00100000:3.0:1787836535.010770:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:11373:x1874682172213504:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 405us (1395us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787836535.010777:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 144 00000100:00100000:2.0:1787836535.018609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836535.018758:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172213760 00000100:00100000:3.0:1787836535.018769:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172213760 00000100:00100000:3.0:1787836535.018826:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:3.0:1787836535.018836:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:11373:x1874682172213760:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836535.019494:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11373:x1874682172213760:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 655us (892us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787836535.019503:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:2.0:1787836535.120421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836535.120583:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172213888 00000100:00100000:0.0:1787836535.120594:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172213888 00000100:00100000:0.0:1787836535.120668:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 145 00000100:00100000:0.0:1787836535.120678:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11379:x1874682172213888:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836535.120701:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836535.120721:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7e88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0a2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.120783:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.120796:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.120808:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836535.120886:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787836535.120890:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836535.120927:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.120965:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7e88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0a2 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.120984:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0a2 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.120993:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:0.0:1787836535.120996:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836535.120999:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3e400, rc 0) 00000100:00100000:0.0:1787836535.122241:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+21:11379:x1874682172213888:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1554us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836535.122251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 145 00000100:00100000:1.0:1787836535.132719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836535.134820:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172214144 00000100:00100000:3.0:1787836535.134837:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172214144 00000100:00100000:3.0:1787836535.134939:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 146 00000100:00100000:3.0:1787836535.135258:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+21:11379:x1874682172214144:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836535.135281:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836535.135317:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0a9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.135426:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab7e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.135441:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.135454:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836535.135465:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787836535.135614:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7e96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0a9 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.135637:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab7e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0a9 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.135646:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d224ad00) 00010000:00010000:3.0:1787836535.135649:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836535.135652:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a400, rc 0) 00000100:00100000:3.0:1787836535.136217:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+23:11379:x1874682172214144:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1263us (3501us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787836535.136227:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 146 00000100:00100000:2.0:1787836535.150151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836535.150297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836535.150387:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172214528 00000100:00100000:1.0:1787836535.150397:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172214528 00000100:00100000:1.0:1787836535.150472:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1787836535.150482:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+23:2362:x1874682172214528:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836535.150499:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836535.150526:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab7e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0a9 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.150546:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d224ad00) 00010000:00010000:1.0:1787836535.150566:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836535.150632:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+22:2362:x1874682172214528:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836535.150641:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:0.0:1787836535.152538:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172214400 00000100:00100000:0.0:1787836535.152553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172214400 00000100:00100000:1.0:1787836535.152759:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 147 00000100:00100000:1.0:1787836535.152771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+22:11379:x1874682172214400:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836535.152797:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836535.152820:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0b0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.154854:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7eb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.154876:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.154888:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7eb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836535.154974:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787836535.155195:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0b0 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.155216:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7eb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0b0 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.155225:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d224ad00) 00010000:00010000:1.0:1787836535.155228:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787836535.155232:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4a00, rc 0) 00000100:00100000:1.0:1787836535.155345:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+24:11379:x1874682172214400:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 2575us (7508us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787836535.155355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 147 00000100:00100000:2.0:1787836535.167830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836535.169455:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172214656 00000100:00100000:1.0:1787836535.169474:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172214656 00000100:00100000:1.0:1787836535.169763:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:1.0:1787836535.169781:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172214656:12345-192.168.203.25@tcp:1:lfs.0 00010000:00010000:1.0:1787836535.169844:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.169868:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.169878:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836535.169884:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787836535.169890:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.169934:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.169948:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 6 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836535.169962:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1874682193194240:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836535.170177:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0500780 going to sleep for 11 seconds 00000100:00080000:2.0:1787836535.171532:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836535.177148:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1874682193194240:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836535.177187:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836535.177420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836535.177516:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172214784 00000100:00100000:3.0:1787836535.177525:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172214784 00002000:00100000:3.0:1787836535.177630:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98e401d1a940 x1874682172214784/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:321/0 lens 504/0 e 0 to 0 dl 1787836546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787836535.177641:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401d1a940 with x1874682172214784 ext(0->12) 00010000:00010000:3.0:1787836535.177673:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 7 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.177688:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 7 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836535.177706:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e401d1a940 00000100:00100000:3.0:1787836535.177745:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:3.0:1787836535.177757:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172214784:12345-192.168.203.25@tcp:4:lfs.0 00000100:00100000:3.0:1787836535.178775:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172214784:12345-192.168.203.25@tcp:4:lfs.0 Request processed in 1014us (1352us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787836535.178786:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00002000:00100000:3.0:1787836535.178794:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98e401d1a940 x1874682172214784/t4294967305(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:321/0 lens 504/448 e 0 to 0 dl 1787836546 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787836535.178804:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401d1a940 with x1874682172214784 ext(0->12) 00010000:00010000:3.0:1787836535.178812:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 9 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.178828:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 9 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836535.178835:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e401d1a940 00000100:00100000:3.0:1787836535.186304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836535.187303:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172214912 00000100:00100000:0.0:1787836535.187317:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172214912 00010000:00010000:0.0:1787836535.187460:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 9 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836535.187509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1787836535.187520:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2361:x1874682172214912:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836535.187538:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787836535.187570:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787836535.187573:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787836534 00002000:00010000:0.0:1787836535.187575:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787836534 00002000:00010000:0.0:1787836535.187577:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787836534 00010000:00010000:0.0:1787836535.187584:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 9 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.187600:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 9 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.187631:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bd5fa0a/0x966835ea68ab7e73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee094 expref: 9 pid: 6692 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.187650:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787836535.187655:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787836535.187661:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.187672:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.188190:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836535.188275:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2361:x1874682172214912:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 754us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836535.188285:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00010000:00010000:1.0:1787836535.189453:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.189472:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.189510:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.189518:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.189527:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.189534:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836535.189538:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.189546:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.189589:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.189598:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8b32f67/0x966835ea68ab7ec0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836535.190281:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172214656:12345-192.168.203.25@tcp:1:lfs.0 Request processed in 20498us (22456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836535.190295:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:3.0:1787836535.195022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836535.195243:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172215168 00000100:00100000:1.0:1787836535.195254:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172215168 00000100:00100000:1.0:1787836535.195353:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:1.0:1787836535.195375:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+24:11379:x1874682172215168:12345-192.168.203.25@tcp:35:lfs.0 00000004:00010000:1.0:1787836535.195456:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7eb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0b0 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836535.195822:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787836535.195868:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787836535.197301:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787836535.197394:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.197416:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.197427:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.197473:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.197490:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 28 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836535.197506:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1874682193194368:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836535.197702:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0500780 going to sleep for 11 seconds 00000100:00100000:1.0:1787836535.200145:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1874682193194368:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836535.200182:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836535.201780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836535.202234:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172215296 00000100:00100000:0.0:1787836535.202248:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172215296 00010000:00010000:0.0:1787836535.202302:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 29 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836535.202369:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:0.0:1787836535.202381:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+29:2363:x1874682172215296:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836535.202414:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836535.202421:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 29 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.202435:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 29 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.202597:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab7e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee086 expref: 29 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.202621:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d224ad00) 00010000:00010000:0.0:1787836535.202704:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.202717:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.202725:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.202759:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836535.202911:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+28:2363:x1874682172215296:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 530us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836535.202919:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00010000:00010000:1.0:1787836535.202988:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.202996:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836535.203358:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787836535.203602:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787836535.206019:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874682193194496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787836535.206280:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836535.206318:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0500540 going to sleep for 11 seconds 00000100:00100000:3.0:1787836535.206514:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193194496 00000100:00100000:3.0:1787836535.206538:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193194496 00000100:00100000:3.0:1787836535.206675:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787836535.206688:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874682193194496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787836535.206797:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874682193194496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836535.206814:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787836535.207118:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874682193194496:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1787836535.207257:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787836535.208546:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787836535.208720:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874682193194624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787836535.208890:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836535.208991:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0500780 going to sleep for 11 seconds 00000100:00100000:3.0:1787836535.209401:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193194624 00000100:00100000:3.0:1787836535.209410:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193194624 00000100:00100000:3.0:1787836535.209544:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787836535.209555:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874682193194624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787836535.209801:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1874682193194624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 247us (910us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787836535.209809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787836535.209917:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874682193194624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787836535.209983:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787836535.210025:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.210037:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.210044:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.210050:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836535.210054:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.210096:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.210114:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d224ad00) 00010000:00010000:1.0:1787836535.210117:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787836535.210122:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.210129:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ec7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836535.210321:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787836535.210414:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787836535.210425:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383643365587ns, next at 384643363695ns, rc = 0 00000001:00080000:1.0:1787836535.210443:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787836535.210478:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d224ad00) 00010000:00010000:1.0:1787836535.210481:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787836535.210488:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7eb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0b0 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836535.210588:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+31:11379:x1874682172215168:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 15217us (15577us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787836535.210597:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000020:00080000:1.0:1787836535.210601:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787836535.219623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836535.219841:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172215424 00000100:00100000:0.0:1787836535.219866:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172215424 00000100:00100000:0.0:1787836535.219996:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 148 00000100:00100000:0.0:1787836535.220008:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+31:11379:x1874682172215424:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836535.220032:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836535.220555:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7ece lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0b7 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.220639:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7ece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0b7 expref: 32 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.220657:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7ece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0b7 expref: 32 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.220678:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836535.220683:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787836535.220687:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3f600, rc 0) 00000100:00100000:0.0:1787836535.220781:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+32:11379:x1874682172215424:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 775us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836535.220790:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 148 00000100:00100000:2.0:1787836535.234335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836535.234549:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172215680 00000100:00100000:3.0:1787836535.234559:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172215680 00000100:00100000:3.0:1787836535.234625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:3.0:1787836535.234636:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+32:11379:x1874682172215680:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836535.235323:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+33:11379:x1874682172215680:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 410us (719us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787836535.235335:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1787836535.356293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836535.359578:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172215936 00000100:00100000:0.0:1787836535.359594:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172215936 00000100:00100000:0.0:1787836535.359682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00100000:0.0:1787836535.359693:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+33:11389:x1874682172215936:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836535.359717:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836535.359749:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0be expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836535.359872:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787836535.360020:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ed5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0be expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.360035:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:0.0:1787836535.360038:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787836535.360043:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0be expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.360514:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3f200, rc 0) 00000100:00100000:0.0:1787836535.360602:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+34:11389:x1874682172215936:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 910us (4317us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787836535.360611:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00100000:2.0:1787836535.367598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836535.367727:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172216064 00000100:00100000:3.0:1787836535.367750:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172216064 00000100:00100000:0.0:1787836535.367901:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:0.0:1787836535.367915:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+34:11389:x1874682172216064:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1787836535.368005:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368025:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368038:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368055:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368122:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368129:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368236:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368244:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368252:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787836535.368291:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368304:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368311:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368319:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368324:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836535.368328:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368336:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368348:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:0.0:1787836535.368351:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836535.368356:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368369:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368381:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368387:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368392:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368397:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836535.368400:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368406:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368413:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836535.368416:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836535.368418:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368424:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab7eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368438:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368444:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368467:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368472:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836535.368475:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368481:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368488:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836535.368491:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836535.368493:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836535.368500:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab7ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836535.368579:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+34:11389:x1874682172216064:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 667us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836535.368586:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:2.0:1787836535.372025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836535.372169:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172216320 00000100:00100000:1.0:1787836535.372177:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172216320 00000100:00100000:1.0:1787836535.372236:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:1.0:1787836535.372246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+34:11389:x1874682172216320:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1787836535.372505:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+35:11389:x1874682172216320:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 260us (490us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787836535.372513:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:2.0:1787836535.453188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836535.453405:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172216576 00000100:00100000:1.0:1787836535.453417:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172216576 00000100:00100000:1.0:1787836535.453476:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 151 00000100:00100000:1.0:1787836535.453486:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+35:11392:x1874682172216576:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836535.453511:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836535.453531:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ef8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0c5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.453606:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.453641:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.453654:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.453669:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.453676:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.453682:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454414:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454426:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454435:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836535.454446:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787836535.454547:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454556:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454563:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454577:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836535.454582:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454589:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454604:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836535.454607:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836535.454613:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454619:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7eff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454634:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454640:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454647:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454651:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836535.454654:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454660:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454678:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836535.454681:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836535.454685:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454690:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab7ef8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454775:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836535.454782:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:1.0:1787836535.454784:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836535.454787:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4a00, rc 0) 00000100:00100000:1.0:1787836535.454863:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+37:11392:x1874682172216576:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1379us (1686us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787836535.454872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 151 00000100:00100000:0.0:1787836535.469528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836535.471368:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172216704 00000100:00100000:3.0:1787836535.471380:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172216704 00000100:00100000:3.0:1787836535.471451:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 152 00000100:00100000:3.0:1787836535.471461:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+37:11392:x1874682172216704:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:3.0:1787836535.471528:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471569:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471580:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471606:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471613:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471620:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471695:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836535.471700:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471708:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471719:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:3.0:1787836535.471722:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787836535.471726:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.471733:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836535.471864:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+37:11392:x1874682172216704:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 404us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836535.471878:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 152 00000100:00100000:2.0:1787836535.489812:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836535.490117:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172216960 00000100:00100000:1.0:1787836535.490129:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172216960 00000100:00100000:1.0:1787836535.490249:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:1.0:1787836535.490260:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+37:11392:x1874682172216960:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1787836535.490506:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+38:11392:x1874682172216960:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 247us (706us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787836535.490514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:2.0:1787836535.535878:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193195136:0@lo:400:kworker.0 00000100:00100000:2.0:1787836535.535959:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836535.536029:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836535.536048:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193195008:0@lo:400:kworker.0 00000100:00100000:2.0:1787836535.536108:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836535.536148:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193195136 00000100:00100000:2.0:1787836535.536155:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193195136 00000100:00100000:2.0:1787836535.536211:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787836535.536223:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193195136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836535.536287:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193195136:12345-0@lo:400:kworker.0 Request processed in 67us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836535.536295:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1787836535.536319:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836535.536351:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193195136:0@lo:400:kworker.0 00000100:00100000:2.0:1787836535.536375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193195008 00000100:00100000:2.0:1787836535.536378:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193195008 00000100:00080000:2.0:1787836535.536393:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836535.536421:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787836535.536427:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193195008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836535.536469:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193195008:12345-0@lo:400:kworker.0 Request processed in 42us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836535.536475:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787836535.536501:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193195008:0@lo:400:kworker.0 00000100:00100000:1.0:1787836535.537094:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193194752:0@lo:400:kworker.0 00000100:00100000:1.0:1787836535.537139:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836535.537167:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193195264:0@lo:400:kworker.0 00000100:00100000:1.0:1787836535.537190:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836535.537219:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836535.537225:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193194880:0@lo:400:kworker.0 00000100:00100000:1.0:1787836535.537262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836535.537295:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193195264 00000100:00100000:1.0:1787836535.537300:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193195264 00000100:00100000:1.0:1787836535.537337:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193194880 00000100:00100000:1.0:1787836535.537341:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193194880 00000100:00100000:1.0:1787836535.537356:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787836535.537362:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193195264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836535.537401:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193195264:12345-0@lo:400:kworker.0 Request processed in 39us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836535.537408:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787836535.537425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787836535.537431:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193194880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836535.537474:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193194880:12345-0@lo:400:kworker.0 Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836535.537479:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787836535.537495:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836535.537515:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193194880:0@lo:400:kworker.0 00000100:00100000:1.0:1787836535.537525:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193195264:0@lo:400:kworker.0 00000100:00100000:0.0:1787836535.537711:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193194752 00000100:00100000:0.0:1787836535.537717:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193194752 00000100:00100000:0.0:1787836535.537751:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787836535.537758:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193194752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836535.537802:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193194752:12345-0@lo:400:kworker.0 Request processed in 44us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836535.537808:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787836535.537865:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193194752:0@lo:400:kworker.0 00000100:00100000:1.0:1787836535.886027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836535.886122:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172217216 00000100:00100000:2.0:1787836535.886134:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172217216 00000100:00100000:2.0:1787836535.886252:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 153 00000100:00100000:2.0:1787836535.886263:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+38:11423:x1874682172217216:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:2.0:1787836535.886293:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836535.886318:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7f22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.886454:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.886482:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.886497:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836535.886511:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787836535.886655:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7f22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0cc expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.886674:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0cc expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.886682:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:2.0:1787836535.886685:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836535.886688:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005aa00, rc 0) 00000100:00100000:2.0:1787836535.886777:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+40:11423:x1874682172217216:12345-192.168.203.25@tcp:101:cat.0 Request processed in 516us (758us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787836535.886785:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 153 00000100:00100000:0.0:1787836535.891132:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836535.891181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836535.891273:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172217600 00000100:00100000:3.0:1787836535.891286:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172217600 00000100:00100000:3.0:1787836535.891368:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:3.0:1787836535.891381:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+40:2362:x1874682172217600:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836535.891402:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836535.891438:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab7f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0cc expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.891460:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:3.0:1787836535.891465:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836535.891526:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+39:2362:x1874682172217600:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836535.891534:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:3.0:1787836535.891559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172217472 00000100:00100000:3.0:1787836535.891563:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172217472 00000100:00100000:3.0:1787836535.891587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:3.0:1787836535.891592:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+39:11423:x1874682172217472:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:3.0:1787836535.891817:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+40:11423:x1874682172217472:12345-192.168.203.25@tcp:35:cat.0 Request processed in 224us (698us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787836535.891823:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00010000:00010000:2.0:1787836535.982409:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836535.991156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836535.991252:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172217856 00000100:00100000:2.0:1787836535.991262:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172217856 00000100:00100000:2.0:1787836535.991330:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 154 00000100:00100000:2.0:1787836535.991341:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+40:11430:x1874682172217856:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:2.0:1787836535.991389:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836535.991392:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787836535.991427:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7e8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0a2 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.991448:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836535.991454:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836535.991470:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7f37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0d3 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.991733:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.991748:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.991757:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.991792:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.991806:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 40 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836535.991822:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193195392:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836535.991965:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787836535.998643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836535.998881:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193195392:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836535.998929:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836535.999111:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172217984 00000100:00100000:3.0:1787836535.999120:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172217984 00010000:00010000:3.0:1787836535.999161:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 41 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836535.999296:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1787836535.999307:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8602450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+41:2364:x1874682172217984:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836535.999327:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836535.999335:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 41 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.999348:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 41 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.999376:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab7f0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0c5 expref: 41 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.999395:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:3.0:1787836535.999400:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.999411:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.999419:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836535.999690:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836535.999757:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8602450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+40:2364:x1874682172217984:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 451us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836535.999766:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00010000:00010000:2.0:1787836535.999879:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836535.999887:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836535.999908:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787836536.000122:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab7f37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 41 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.000140:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 40 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.000148:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:2.0:1787836536.000150:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787836536.000153:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a000, rc 0) 00000100:00100000:2.0:1787836536.000339:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+40:11430:x1874682172217856:12345-192.168.203.25@tcp:101:dd.0 Request processed in 9000us (9194us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787836536.000347:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 154 00000100:00100000:0.0:1787836536.008718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836536.008801:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172218240 00000100:00100000:1.0:1787836536.008830:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172218240 00000100:00100000:1.0:1787836536.008897:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 155 00000100:00100000:1.0:1787836536.008908:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1449a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+40:11430:x1874682172218240:12345-192.168.203.25@tcp:36:dd.0 00010000:00010000:1.0:1787836536.009378:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.009398:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.009411:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836536.009466:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787836536.010705:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcbee300 reply state 00000000eb4cfd50 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836536.010723:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836536.010868:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1449a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+43:11430:x1874682172218240:12345-192.168.203.25@tcp:36:dd.0 Request processed in 1956us (2156us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787836536.010878:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 155 00000020:00080000:1.0:1787836536.010887:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787836536.013723:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.013765:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.013776:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.013782:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836536.013788:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.013797:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.013819:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:3.0:1787836536.013823:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836536.013829:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.013836:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab7f4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836536.047013:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836536.047038:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193195520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836536.047270:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836536.049319:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193195520 00000100:00100000:1.0:1787836536.049337:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193195520 00000100:00100000:1.0:1787836536.049416:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787836536.049427:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193195520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787836536.049452:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836536.049823:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193195520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 397us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836536.049831:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787836536.055397:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193195520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836536.303176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836536.303660:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172218368 00000100:00100000:1.0:1787836536.303687:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172218368 00000100:00100000:1.0:1787836536.303760:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 156 00000100:00100000:1.0:1787836536.303771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+42:11444:x1874682172218368:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:1.0:1787836536.303797:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836536.303818:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0da expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.303892:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.303907:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.303918:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.303929:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.303935:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.303941:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.304035:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.304047:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 43 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.304055:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.304132:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 43 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.304155:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 43 pid: 10086 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836536.304170:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401f961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193195648:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836536.304290:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0500e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787836536.311980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836536.312629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172218624 00000100:00100000:3.0:1787836536.312640:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172218624 00000100:00100000:3.0:1787836536.312708:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:3.0:1787836536.312719:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+44:5598:x1874682172218624:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787836536.313049:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+45:5598:x1874682172218624:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 332us (1079us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787836536.313111:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:1.0:1787836536.314621:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401f961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193195648:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836536.314660:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836536.316749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836536.317425:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172218752 00000100:00100000:2.0:1787836536.317438:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172218752 00010000:00010000:2.0:1787836536.317491:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 45 pid: 10086 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836536.317540:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:2.0:1787836536.317638:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+45:2363:x1874682172218752:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836536.317658:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836536.317666:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 45 pid: 10086 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.317681:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 45 pid: 10086 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.317707:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0d3 expref: 45 pid: 10086 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.317725:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:2.0:1787836536.317731:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.317740:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.317747:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.317782:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836536.317848:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+44:2363:x1874682172218752:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 213us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836536.317856:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00010000:00010000:1.0:1787836536.318466:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318476:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836536.318522:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787836536.318526:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836536.318544:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318628:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318640:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318663:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318669:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318675:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836536.318680:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318687:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318698:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836536.318701:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836536.318706:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318712:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7f5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318725:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318731:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318736:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318740:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836536.318748:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318754:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318761:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836536.318764:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836536.318767:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318773:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318818:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0da expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318830:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0da expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.318837:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:1.0:1787836536.318839:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836536.318841:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4000, rc 0) 00000100:00100000:1.0:1787836536.318886:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+43:11444:x1874682172218368:12345-192.168.203.25@tcp:101:stat.0 Request processed in 15118us (15721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836536.318894:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 156 00000100:00100000:2.0:1787836536.417875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836536.417975:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172219008 00000100:00100000:1.0:1787836536.417985:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172219008 00000100:00100000:1.0:1787836536.418042:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 157 00000100:00100000:1.0:1787836536.418051:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+43:11450:x1874682172219008:12345-192.168.203.25@tcp:36:truncate.0 00010000:00010000:1.0:1787836536.418374:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836536.418401:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab7f68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0da expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.418421:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:1.0:1787836536.418426:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836536.418600:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.418613:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.418622:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836536.418663:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787836536.418683:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000deb6c39 reply state 00000000c5934744 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836536.418692:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836536.418776:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+45:11450:x1874682172219008:12345-192.168.203.25@tcp:36:truncate.0 Request processed in 726us (922us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787836536.418784:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 157 00000020:00080000:1.0:1787836536.418788:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787836536.429397:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.429571:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.429578:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.429585:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836536.429591:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.429609:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.429633:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:3.0:1787836536.429636:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836536.429643:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.429649:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab7f6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836536.649561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836536.649931:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172219136 00000100:00100000:3.0:1787836536.649943:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172219136 00000100:00100000:3.0:1787836536.650020:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 158 00000100:00100000:3.0:1787836536.650029:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+44:11464:x1874682172219136:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:3.0:1787836536.650051:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836536.650116:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0e1 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650180:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650208:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650222:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650239:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650247:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650253:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650386:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650400:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650412:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836536.650488:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787836536.650497:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836536.650529:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650542:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650574:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650584:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650595:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650604:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836536.650611:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650657:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650678:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836536.650683:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836536.650692:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650700:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab7f7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650721:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650730:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650738:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650758:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836536.650764:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650773:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650786:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d224a000) 00010000:00010000:3.0:1787836536.650790:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836536.650794:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650803:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab7f84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650863:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab7f76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 46 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650884:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 45 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.650895:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:3.0:1787836536.650898:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836536.650901:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152be00, rc 0) 00000100:00100000:3.0:1787836536.651003:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+45:11464:x1874682172219136:12345-192.168.203.25@tcp:101:stat.0 Request processed in 972us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836536.651014:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 158 00000001:00080000:2.0:1787836536.653127:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1787836536.653145:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1787836536.793803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836536.794866:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172219392 00000100:00100000:2.0:1787836536.794901:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172219392 00000100:00100000:2.0:1787836536.794998:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 159 00000100:00100000:2.0:1787836536.795010:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+45:11474:x1874682172219392:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836536.795031:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836536.795053:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836536.795789:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787836536.795943:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e8 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.795960:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:2.0:1787836536.795964:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836536.795969:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e8 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.796277:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a000, rc 0) 00000100:00100000:2.0:1787836536.796368:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+46:11474:x1874682172219392:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1359us (2576us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787836536.796376:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 159 00000100:00100000:0.0:1787836536.799251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836536.799333:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172219648 00000100:00100000:3.0:1787836536.799359:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172219648 00000100:00100000:3.0:1787836536.799416:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:3.0:1787836536.799426:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+46:11474:x1874682172219648:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836536.799764:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+47:11474:x1874682172219648:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 337us (523us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787836536.799773:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:0.0:1787836536.904168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836536.904271:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172219904 00000100:00100000:1.0:1787836536.904283:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172219904 00000100:00100000:1.0:1787836536.904359:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 160 00000100:00100000:1.0:1787836536.904370:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+47:11480:x1874682172219904:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836536.904400:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836536.904443:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7fa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0ef expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.904579:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.904596:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 48 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.904606:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.904666:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 48 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.904680:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 48 pid: 10086 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836536.904695:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401f961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193195776:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836536.904816:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d84abc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787836536.912447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836536.912518:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172220032 00000100:00100000:2.0:1787836536.912528:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172220032 00010000:00010000:2.0:1787836536.912570:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 49 pid: 10086 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836536.912613:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:2.0:1787836536.912623:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f96940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+49:2363:x1874682172220032:12345-192.168.203.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787836536.912657:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401f961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193195776:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836536.912658:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836536.912664:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 49 pid: 10086 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.912676:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 49 pid: 10086 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836536.912687:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.912700:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab7f8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0e1 expref: 49 pid: 10086 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.913818:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:2.0:1787836536.913829:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.913842:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.913850:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.913893:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836536.913974:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f96940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+48:2363:x1874682172220032:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1348us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836536.913983:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 66 00010000:00010000:0.0:1787836536.914261:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836536.914279:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836536.914303:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787836536.914485:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab7fa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836536.914524:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836536.914532:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836536.914535:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787836536.914537:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5a00, rc 0) 00000100:00100000:0.0:1787836536.914570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+48:11480:x1874682172219904:12345-192.168.203.25@tcp:101:bash.0 Request processed in 10203us (10412us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787836536.914883:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 160 00000100:00100000:0.0:1787836536.929195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836536.929503:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172220288 00000100:00100000:1.0:1787836536.929515:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172220288 00000100:00100000:1.0:1787836536.929586:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 161 00000100:00100000:1.0:1787836536.929598:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+48:11480:x1874682172220288:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:1.0:1787836536.930898:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.930926:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.930955:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836536.931049:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787836536.931584:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1ffd357 reply state 00000000624bb4b7 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836536.931595:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836536.931731:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+51:11480:x1874682172220288:12345-192.168.203.25@tcp:36:bash.0 Request processed in 2132us (2545us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787836536.931741:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 161 00000020:00080000:1.0:1787836536.931747:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787836536.939054:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.939129:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.939138:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.939145:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836536.939150:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.939158:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.939571:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:1.0:1787836536.939575:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836536.939596:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836536.939603:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab7fb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836536.950612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836536.951551:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172220416 00000100:00100000:2.0:1787836536.951565:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172220416 00000100:00100000:2.0:1787836536.951720:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 162 00000100:00100000:2.0:1787836536.951733:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+50:11480:x1874682172220416:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836536.951778:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836536.951801:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7fbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0f6 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.951894:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.951911:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.951921:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.951959:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836536.951973:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 51 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836536.951988:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193195904:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836536.953363:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787836536.958590:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193195904:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836536.958622:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836536.960915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836536.963987:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172220544 00000100:00100000:3.0:1787836536.964003:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172220544 00010000:00010000:3.0:1787836536.964053:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 52 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836536.964480:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:3.0:1787836536.964493:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+52:2364:x1874682172220544:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836536.964513:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836536.964520:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 52 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.964535:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 52 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.964558:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab7fa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0ef expref: 52 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.964576:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:3.0:1787836536.964582:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.964617:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.964626:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836536.964670:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836536.964749:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+51:2364:x1874682172220544:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 260us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836536.964897:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00010000:00010000:0.0:1787836536.965495:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836536.965507:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836536.965554:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787836536.965559:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836536.965578:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836536.965612:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7fbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0f6 expref: 51 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836536.965631:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0f6 expref: 50 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836536.965653:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836536.965656:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836536.965659:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a800, rc 0) 00000100:00100000:0.0:1787836536.965722:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+50:11480:x1874682172220416:12345-192.168.203.25@tcp:101:bash.0 Request processed in 13992us (15121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836536.965741:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 162 00000100:00100000:0.0:1787836536.972709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836536.972851:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172220800 00000100:00100000:3.0:1787836536.972861:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172220800 00000100:00100000:3.0:1787836536.972921:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1787836536.972933:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+50:11480:x1874682172220800:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:3.0:1787836536.973334:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+51:11480:x1874682172220800:12345-192.168.203.25@tcp:35:bash.0 Request processed in 403us (634us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787836536.973343:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00010000:00010000:0.0:1787836537.007318:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836537.056976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836537.057107:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172221056 00000100:00100000:2.0:1787836537.057120:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172221056 00000100:00100000:2.0:1787836537.057217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 163 00000100:00100000:2.0:1787836537.057246:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+51:11490:x1874682172221056:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836537.057277:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836537.057303:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7fca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee0fd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836537.057423:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787836537.057709:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7fca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0fd expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.057729:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:2.0:1787836537.057732:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836537.057737:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab7fca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0fd expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.057752:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a000, rc 0) 00000100:00080000:1.0:1787836537.057877:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836537.057916:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+52:11490:x1874682172221056:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 672us (951us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787836537.057924:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 163 00000100:00100000:1.0:1787836537.061392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836537.061514:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172221184 00000100:00100000:0.0:1787836537.061529:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172221184 00000100:00100000:0.0:1787836537.061602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 164 00000100:00100000:0.0:1787836537.061624:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+52:11490:x1874682172221184:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:0.0:1787836537.061734:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.061754:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.061768:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.061787:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.061795:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.061802:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.061951:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.061961:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.061968:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787836537.062014:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062030:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062036:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062043:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062049:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ec00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836537.062053:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062111:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062125:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:0.0:1787836537.062128:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836537.062132:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062145:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7fd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062159:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062165:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062170:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062175:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836537.062178:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062185:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062193:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836537.062195:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836537.062198:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062203:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062219:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062225:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062237:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062242:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836537.062245:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062251:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062259:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836537.062261:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836537.062264:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.062270:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836537.062353:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+52:11490:x1874682172221184:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 740us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836537.062362:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 164 00000100:00100000:2.0:1787836537.066218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836537.066711:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172221440 00000100:00100000:3.0:1787836537.066723:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172221440 00000100:00100000:3.0:1787836537.066819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:3.0:1787836537.066831:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+52:11490:x1874682172221440:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836537.067226:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+53:11490:x1874682172221440:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 374us (997us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787836537.067234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:1.0:1787836537.121917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836537.122019:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172221696 00000100:00100000:3.0:1787836537.122029:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172221696 00000100:00100000:3.0:1787836537.122162:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 165 00000100:00100000:0.0:1787836537.122307:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+53:11493:x1874682172221696:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836537.122335:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836537.122358:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee104 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122442:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122470:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122482:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122497:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122504:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122511:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122659:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122669:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122676:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836537.122687:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787836537.122799:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122808:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122816:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122828:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836537.122833:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122841:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122854:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:0.0:1787836537.122857:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836537.122863:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122870:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab7ff4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122886:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122891:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122896:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122901:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ec00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836537.122903:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122909:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122927:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836537.122930:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836537.122933:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122939:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab7ffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122979:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab7fed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee104 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.122994:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee104 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.123014:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836537.123016:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836537.123019:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3f800, rc 0) 00000100:00100000:0.0:1787836537.123155:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+55:11493:x1874682172221696:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 983us (1248us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787836537.123166:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 165 00000100:00100000:1.0:1787836537.127709:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836537.127772:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172221952 00000100:00100000:3.0:1787836537.127784:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172221952 00000100:00100000:1.0:1787836537.127803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836537.127914:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:3.0:1787836537.127925:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+55:2361:x1874682172221952:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836537.127944:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836537.127975:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee104 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836537.127993:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:3.0:1787836537.127999:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836537.128089:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172221824 00000100:00100000:0.0:1787836537.128094:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172221824 00000100:00100000:3.0:1787836537.128112:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+55:2361:x1874682172221952:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 189us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836537.128119:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:0.0:1787836537.128122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00100000:0.0:1787836537.128128:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+55:11493:x1874682172221824:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1787836537.128198:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128215:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128252:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128282:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128289:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128297:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128303:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836537.128308:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128316:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128325:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836537.128328:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787836537.128332:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.128338:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8010 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836537.128374:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+54:11493:x1874682172221824:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 245us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836537.128381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00100000:1.0:1787836537.132005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836537.132256:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172222208 00000100:00100000:0.0:1787836537.132285:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172222208 00000100:00100000:0.0:1787836537.132524:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:0.0:1787836537.132536:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+54:11493:x1874682172222208:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1787836537.132908:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+55:11493:x1874682172222208:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 374us (913us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787836537.132917:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:2.0:1787836537.290977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836537.291126:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172222464 00000100:00100000:1.0:1787836537.291136:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172222464 00000100:00100000:1.0:1787836537.291194:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:1.0:1787836537.291206:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+55:11511:x1874682172222464:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:1.0:1787836537.291232:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836537.291254:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8017 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee10b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836537.291381:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab801e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836537.291402:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab801e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836537.291414:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab801e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836537.291425:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787836537.291557:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8017 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee10b expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836537.291583:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab801e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee10b expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836537.291591:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:1.0:1787836537.291594:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787836537.291597:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4a00, rc 0) 00000100:00100000:1.0:1787836537.291673:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+57:11511:x1874682172222464:12345-192.168.203.25@tcp:101:cat.0 Request processed in 470us (706us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787836537.291680:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:1.0:1787836537.353145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836537.354482:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172222592 00000100:00100000:0.0:1787836537.354496:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172222592 00000100:00100000:0.0:1787836537.354601:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 168 00000100:00100000:0.0:1787836537.354636:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+57:11512:x1874682172222592:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836537.354674:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836537.354911:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab802c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee112 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.355000:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab8033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.355019:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.355031:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836537.355139:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787836537.355144:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836537.355168:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.355196:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab802c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee112 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.355239:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab8033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee112 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.355247:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:0.0:1787836537.355251:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836537.355254:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3ec00, rc 0) 00000100:00100000:0.0:1787836537.356967:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+58:11512:x1874682172222592:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 2345us (3826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836537.356980:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 168 00000100:00100000:2.0:1787836537.381865:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836537.382803:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172222976 00000100:00100000:3.0:1787836537.382817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172222976 00000100:00100000:3.0:1787836537.382951:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:3.0:1787836537.382964:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+58:11512:x1874682172222976:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836537.383345:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11512:x1874682172222976:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 383us (1489us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787836537.383353:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:2.0:1787836537.386518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836537.391975:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172223104 00000100:00100000:0.0:1787836537.391995:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172223104 00000100:00100000:0.0:1787836537.392335:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1787836537.392347:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11512:x1874682172223104:12345-192.168.203.25@tcp:103:lfs.0 00010000:00010000:0.0:1787836537.392370:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787836537.392403:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab7fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0f6 expref: 59 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.392428:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4a00/0x966835ea68ab801e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee10b expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.392440:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab7ece lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee0b7 expref: 57 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836537.392450:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836537.392463:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836537.392584:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+56:11512:x1874682172223104:12345-192.168.203.25@tcp:103:lfs.0 Request processed in 224us (6065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836537.392594:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:1.0:1787836537.399159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836537.399684:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172223232 00000100:00100000:2.0:1787836537.399695:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172223232 00000100:00100000:2.0:1787836537.399752:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:2.0:1787836537.399763:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+56:11512:x1874682172223232:12345-192.168.203.25@tcp:58:lfs.0 00010000:00010000:2.0:1787836537.399883:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.399915:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.399928:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836537.402348:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787836537.403915:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+56:11512:x1874682172223232:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 4137us (4748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836537.403930:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:1.0:1787836537.427716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836537.427851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172223360 00000100:00100000:0.0:1787836537.427940:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172223360 00000100:00100000:0.0:1787836537.428017:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:0.0:1787836537.428026:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+56:11514:x1874682172223360:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836537.428046:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836537.428131:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee119 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428287:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428304:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428318:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428391:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428401:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428408:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428707:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428734:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428742:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836537.428777:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787836537.428782:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836537.428800:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428812:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428820:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428826:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428832:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428837:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836537.428840:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428847:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428860:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836537.428863:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836537.428876:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428882:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab8048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428898:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428904:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.428909:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.430803:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836537.430811:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.430821:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.430840:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d8034b00) 00010000:00010000:2.0:1787836537.430843:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836537.430847:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.430854:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab804f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.430917:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.430957:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.430965:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034400) 00010000:00010000:2.0:1787836537.430967:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836537.430970:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836537.431052:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+57:11514:x1874682172223360:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 3026us (3343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836537.431094:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:0.0:1787836537.582233:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787836537.582260:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193196032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836537.582352:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836537.582448:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193196032 00000100:00100000:0.0:1787836537.582456:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193196032 00000100:00100000:0.0:1787836537.582520:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787836537.582529:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193196032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836537.582565:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836537.582609:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193196032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836537.582812:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787836537.582835:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836537.584262:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193196032:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787836537.658851:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:3.0:1787836537.658888:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:3.0:1787836537.658915:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787836537.658939:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e3d0500540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787836537.658944:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3c845b200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e3d0500840 00000020:00080000:3.0:1787836537.658947:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3c845b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e3c6158800 00000001:00080000:3.0:1787836537.659000:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:3.0:1787836537.659031:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787836537.659302:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787836537.659576:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193196160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787836537.659775:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836537.659957:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193196160 00000100:00100000:2.0:1787836537.659966:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193196160 00000100:00100000:2.0:1787836537.660085:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787836537.660097:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193196160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787836537.660123:0:10087:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787836537.660159:0:10087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a903876, atime: 0x6a903876, ctime: 0x6a903876, blocks: 0xb 00010000:00010000:2.0:1787836537.660167:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.660184:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1787836537.660188:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836537.660195:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.660212:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.660239:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.660247:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.660265:0:10087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787836537.661017:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193196160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 920us (1239us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787836537.661026:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787836537.661091:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836537.661097:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.661108:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836537.661112:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.661123:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.661144:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.661152:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000520e4eb1/0x966835ea68ab805d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836537.661180:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836537.661182:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836537.661184:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787836537.661967:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787836537.662010:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787836537.662019:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787836537.662055:0:3311:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98e3d3dde1c0 x1874682193196160/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787836553 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787836537.662096:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e3d3dde1c0/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787836537.662102:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193196160:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787836538.040216:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787836538.094974:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787836538.094985:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787836538.095045:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787836538.095052:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787836538.095215:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193196288:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787836538.095380:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8477180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836538.109131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836538.109167:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172223488 00000100:00100000:2.0:1787836538.109175:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172223488 00000100:00100000:2.0:1787836538.109229:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 171 00000100:00100000:2.0:1787836538.109240:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172223488:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787836538.109273:0:5841:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787836538.109378:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172223488:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 138us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836538.109385:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 171 00000100:00100000:3.0:1787836538.109903:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193196288:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787836538.115417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.115735:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172223616 00000100:00100000:1.0:1787836538.115750:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172223616 00000100:00100000:1.0:1787836538.115828:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 172 00000100:00100000:1.0:1787836538.115839:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+16:11525:x1874682172223616:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787836538.115927:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.115947:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.115960:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116048:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116086:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116095:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116126:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116134:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116141:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836538.116177:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787836538.116182:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836538.116194:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116207:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116213:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116220:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116237:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836538.116241:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116249:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116260:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:1.0:1787836538.116264:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836538.116268:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116275:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8064 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116285:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116291:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116295:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116300:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836538.116302:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116308:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116325:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff98e3d1431700) 00010000:00010000:1.0:1787836538.116327:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836538.116330:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116336:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab806b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116349:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116356:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116361:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116366:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836538.116368:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116374:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116381:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034400) 00010000:00010000:1.0:1787836538.116383:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836538.116386:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.116391:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8072 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836538.116482:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+16:11525:x1874682172223616:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 644us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836538.116490:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 172 00000100:00100000:2.0:1787836538.119145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836538.119231:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172223872 00000100:00100000:3.0:1787836538.119241:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172223872 00000100:00100000:3.0:1787836538.119300:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 173 00000100:00100000:3.0:1787836538.119311:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+16:11525:x1874682172223872:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836538.119332:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836538.119354:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8079 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee120 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119471:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119486:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119512:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836538.119527:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787836538.119879:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119887:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119894:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119900:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836538.119904:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119912:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119927:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034400) 00010000:00010000:3.0:1787836538.119929:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787836538.119934:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119940:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.119980:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8079 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee120 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.120002:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:3.0:1787836538.120004:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787836538.120007:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8079 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee120 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.120018:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a800, rc 0) 00000100:00100000:3.0:1787836538.120155:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172223872:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 845us (1017us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787836538.120165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 173 00000100:00100000:2.0:1787836538.124617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.125141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172224000 00000100:00100000:1.0:1787836538.125152:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172224000 00000100:00100000:1.0:1787836538.125220:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 174 00000100:00100000:1.0:1787836538.125231:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172224000:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787836538.125267:0:5842:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787836538.126750:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172224000:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 1513us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836538.126763:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 174 00000100:00100000:0.0:1787836538.130655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836538.130823:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172224256 00000100:00100000:3.0:1787836538.130834:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172224256 00000100:00100000:3.0:1787836538.130899:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 175 00000100:00100000:3.0:1787836538.130909:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172224256:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836538.130932:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836538.130935:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787836538.130967:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab8033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee112 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.130987:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836538.130993:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836538.131007:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab808e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee127 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787836538.133001:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787836538.138357:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.138396:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.138410:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.138489:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab808e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee127 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.138509:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee127 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.138961:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836538.138968:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836538.138973:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a800, rc 0) 00000100:00100000:0.0:1787836538.139873:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11525:x1874682172224256:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 8957us (9223us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787836538.139884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 175 00000100:00100000:2.0:1787836538.143794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.143854:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172224512 00000100:00100000:1.0:1787836538.143867:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172224512 00000100:00100000:1.0:1787836538.143934:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 176 00000100:00100000:1.0:1787836538.143944:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11525:x1874682172224512:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787836538.144008:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836538.144038:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee127 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144113:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:1.0:1787836538.144128:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836538.144156:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144169:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144202:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144217:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144225:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144231:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144652:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144661:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144668:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144674:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836538.144678:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144685:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144695:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836538.144697:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836538.144701:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144715:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab80a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144726:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144732:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144737:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144742:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836538.144745:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144750:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144758:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x66bef82c (ffff98e3d1431700) 00010000:00010000:1.0:1787836538.144761:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836538.144764:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.144770:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab80aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x66bef82c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836538.144907:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172224512:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 962us (1124us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787836538.144915:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 176 00000100:00100000:2.0:1787836538.151227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836538.153935:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172224640 00000100:00100000:0.0:1787836538.153951:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172224640 00000100:00100000:0.0:1787836538.154039:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 177 00000100:00100000:0.0:1787836538.154050:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172224640:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836538.157491:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836538.157529:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab80b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee12e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.157597:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.157610:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.157625:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.157731:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab80b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.157752:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.157760:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:2.0:1787836538.157763:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787836538.157767:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005bc00, rc 0) 00000100:00100000:2.0:1787836538.157989:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11525:x1874682172224640:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 3939us (6772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836538.157998:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 177 00000100:00100000:0.0:1787836538.171853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836538.172003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172224896 00000100:00100000:2.0:1787836538.172015:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172224896 00000100:00100000:2.0:1787836538.172107:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 178 00000100:00100000:2.0:1787836538.172117:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11525:x1874682172224896:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787836538.172204:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.172242:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.172254:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836538.172562:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1787836538.172572:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386605513319ns, next at 387605510064ns, rc = 0 00000004:00010000:2.0:1787836538.172663:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bde66f7a reply state 000000001d19067a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836538.172672:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787836538.173722:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11525:x1874682172224896:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 663us (936us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787836538.173736:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 178 00000100:00100000:2.0:1787836538.179172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00010000:00010000:3.0:1787836538.179240:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.179252:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.179259:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.179265:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836538.179269:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.179277:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.179306:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:3.0:1787836538.179309:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787836538.179313:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.179320:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab80bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836538.179399:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172225024 00000100:00100000:0.0:1787836538.179408:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172225024 00000100:00100000:0.0:1787836538.179457:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 179 00000100:00100000:0.0:1787836538.179466:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:11525:x1874682172225024:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787836538.179488:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836538.179503:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee135 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.179553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.179565:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.179581:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:0.0:1787836538.179584:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787836538.179586:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3e400, rc 0) 00000100:00100000:0.0:1787836538.179892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11525:x1874682172225024:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 426us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836538.179900:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 179 00000100:00100000:1.0:1787836538.190021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836538.190112:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172225152 00000100:00100000:2.0:1787836538.190122:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172225152 00000100:00100000:2.0:1787836538.190189:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:2.0:1787836538.190199:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172225152:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787836538.190551:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172225152:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 351us (541us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787836538.190559:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00080000:1.0:1787836538.190879:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836538.206540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836538.206721:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172225408 00000100:00100000:0.0:1787836538.206733:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172225408 00000100:00100000:0.0:1787836538.206800:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:0.0:1787836538.206812:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11525:x1874682172225408:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787836538.207097:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+21:11525:x1874682172225408:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 286us (568us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787836538.207106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:0.0:1787836538.213648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.213765:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172225664 00000100:00100000:1.0:1787836538.213776:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172225664 00000100:00100000:1.0:1787836538.213847:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 180 00000100:00100000:1.0:1787836538.213859:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+21:11525:x1874682172225664:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787836538.214004:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+21:11525:x1874682172225664:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 147us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836538.214012:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 180 00000100:00100000:0.0:1787836538.223747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.223850:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172225792 00000100:00100000:1.0:1787836538.223861:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172225792 00000100:00100000:1.0:1787836538.223920:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 181 00000100:00100000:1.0:1787836538.223930:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+21:11525:x1874682172225792:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836538.223950:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836538.223970:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab80cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee13c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.224034:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab80d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.224048:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab80d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.224094:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab80d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836538.224135:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836538.224154:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab80d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.224193:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab80cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee13c expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.224210:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab80d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee13c expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.224218:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:1.0:1787836538.224221:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787836538.224224:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5000, rc 0) 00000100:00100000:1.0:1787836538.224281:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+22:11525:x1874682172225792:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 352us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836538.224288:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 181 00000100:00100000:0.0:1787836538.236779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836538.236861:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172225920 00000100:00100000:2.0:1787836538.236872:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172225920 00000100:00100000:2.0:1787836538.236938:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:2.0:1787836538.236949:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172225920:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836538.236974:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836538.236995:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee143 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787836538.237020:0:10087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a903879, blocks: 0x1 00010000:00010000:2.0:1787836538.237040:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1787836538.237045:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836538.237055:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 8 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.237106:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 8 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836538.237120:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005be00, rc 0) 00000100:00100000:2.0:1787836538.237180:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172225920:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 233us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836538.237188:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:3.0:1787836538.259016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836538.259117:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172226176 00000100:00100000:3.0:1787836538.259129:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172226176 00000100:00100000:3.0:1787836538.259189:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 182 00000100:00100000:3.0:1787836538.259200:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+22:11525:x1874682172226176:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787836538.259307:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+22:11525:x1874682172226176:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 110us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836538.259316:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 182 00000100:00100000:1.0:1787836538.278806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836538.281882:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172226304 00000100:00100000:3.0:1787836538.281901:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172226304 00000100:00100000:3.0:1787836538.281993:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:3.0:1787836538.282004:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+8:11525:x1874682172226304:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836538.282025:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836538.282046:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee14a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.282119:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 9 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.282144:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836538.282148:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836538.282154:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.282195:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 9 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.282210:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 9 pid: 10087 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836538.282225:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1874682193196416:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836538.285796:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ef7d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787836538.290805:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1874682193196416:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836538.290851:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.290874:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152be00, rc 0) 00000100:00100000:1.0:1787836538.290935:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+9:11525:x1874682172226304:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 8934us (12138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836538.290944:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1787836538.291034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836538.291097:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172226432 00000100:00100000:0.0:1787836538.291104:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172226432 00010000:00010000:0.0:1787836538.291140:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 9 pid: 10087 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836538.291170:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:0.0:1787836538.291179:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2364:x1874682172226432:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836538.291192:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836538.291219:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 9 pid: 10087 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.291233:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 9 pid: 10087 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.291257:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab80db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee143 expref: 9 pid: 10087 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.291287:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836538.291291:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836538.291301:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.291312:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.291351:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836538.291378:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1874682193196544:192.168.203.25@tcp:105: 00000100:00100000:0.0:1787836538.291440:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c56730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836538.295863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836538.296115:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172226560 00000100:00100000:0.0:1787836538.296126:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172226560 00002000:00100000:0.0:1787836538.296187:0:6696:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98e401fbb480 x1874682172226560/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:324/0 lens 504/0 e 0 to 0 dl 1787836549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787836538.296200:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401fbb480 with x1874682172226560 ext(0->8) 00002000:00010000:0.0:1787836538.296208:0:6696:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e401fbb480 00000100:00100000:0.0:1787836538.296241:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1787836538.296254:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172226560:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787836538.296783:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+11:2363:x1874682172226560:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 Request processed in 530us (932us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787836538.296802:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00002000:00100000:0.0:1787836538.296811:0:6696:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98e401fbb480 x1874682172226560/t4294967314(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:324/0 lens 504/448 e 0 to 0 dl 1787836549 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787836538.296820:0:6696:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401fbb480 with x1874682172226560 ext(0->8) 00002000:00010000:0.0:1787836538.296824:0:6696:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e401fbb480 00000100:00100000:0.0:1787836538.297339:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1874682193196544:192.168.203.25@tcp:105: 00010000:00010000:0.0:1787836538.297363:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836538.297401:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+10:2364:x1874682172226432:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 6224us (6368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836538.297410:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:1.0:1787836538.308393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836538.308570:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172226688 00000100:00100000:2.0:1787836538.308580:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172226688 00000100:00100000:2.0:1787836538.308677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 183 00000100:00100000:2.0:1787836538.308688:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+22:11525:x1874682172226688:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1787836538.355898:0:12416:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787836538.355908:0:12416:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787836538.355950:0:12416:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787836538.355958:0:12416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787836538.402420:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+22:11525:x1874682172226688:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 93723us (94031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836538.402442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 183 00000001:00080000:2.0:1787836538.402484:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787836538.402505:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787836538.402524:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787836538.402542:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787836538.402559:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787836538.406654:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3eeaf0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193196672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787836538.406739:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836538.407185:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193196672 00000100:00100000:0.0:1787836538.407194:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193196672 00000100:00100000:0.0:1787836538.407252:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787836538.407264:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb945a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193196672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787836538.407663:0:10087:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787836538.407668:0:10087:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787836537 00002000:00010000:0.0:1787836538.407672:0:10087:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787836538.407674:0:10087:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787836537 -> 1787836537 00002000:00010000:0.0:1787836538.407677:0:10087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787836538.407745:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb945a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193196672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 484us (1005us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787836538.407763:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787836538.407825:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e3eeaf0f00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787836538.407840:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3eeaf0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193196672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787836538.414880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836538.415227:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172226816 00000100:00100000:3.0:1787836538.415236:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172226816 00000100:00100000:3.0:1787836538.415289:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:3.0:1787836538.415298:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+10:2364:x1874682172226816:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787836538.474456:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836538.474667:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172227072 00000100:00100000:3.0:1787836538.474679:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172227072 00000100:00100000:3.0:1787836538.474755:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00100000:3.0:1787836538.474766:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172227072:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836538.474850:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172227072:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 87us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836538.474875:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00080000:1.0:1787836538.475663:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787836538.475987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836538.476149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836538.476177:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172226944 00000100:00100000:0.0:1787836538.476184:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172226944 00000100:00100000:0.0:1787836538.476232:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 302 00000100:00100000:0.0:1787836538.476241:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2363:x1874682172226944:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836538.476298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2363:x1874682172226944:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 58us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836538.476306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 302 00000100:00100000:0.0:1787836538.476339:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172227200 00000100:00100000:0.0:1787836538.476342:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172227200 00000100:00100000:0.0:1787836538.476385:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00100000:0.0:1787836538.476392:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2363:x1874682172227200:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836538.476426:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2363:x1874682172227200:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 34us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836538.476433:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00080000:1.0:1787836538.476718:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787836538.494856:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1787836538.494876:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1787836538.495653:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172226816:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 80347us (80779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836538.495667:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:2.0:1787836538.524867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836538.525562:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172227456 00000100:00100000:3.0:1787836538.525574:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172227456 00000100:00100000:3.0:1787836538.525643:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 184 00000100:00100000:3.0:1787836538.525653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11525:x1874682172227456:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787836538.525723:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836538.525755:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab80d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee13c expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.525780:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:3.0:1787836538.525785:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836538.525825:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.525844:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.525854:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787836538.526234:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fa0062d reply state 00000000a110df3c transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836538.526243:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787836538.526473:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:11525:x1874682172227456:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 821us (1619us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787836538.526492:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 184 00000100:00100000:1.0:1787836538.536435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836538.536637:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172227584 00000100:00100000:2.0:1787836538.536648:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172227584 00000100:00100000:2.0:1787836538.536718:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:2.0:1787836538.536729:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172227584:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787836538.536995:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787836538.536998:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787836537 -> 1787836536 00002000:00010000:2.0:1787836538.537001:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787836534 00002000:00010000:2.0:1787836538.537003:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787836537 -> 1787836536 00002000:00010000:2.0:1787836538.537005:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787836538.537104:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172227584:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 376us (680us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787836538.537113:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00010000:00010000:3.0:1787836538.537692:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.537769:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.537779:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.537785:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836538.537790:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.537798:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.537818:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:3.0:1787836538.537821:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836538.537826:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.537832:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab80e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836538.542538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836538.542629:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172227840 00000100:00100000:3.0:1787836538.542640:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172227840 00000100:00100000:3.0:1787836538.542703:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 185 00000100:00100000:3.0:1787836538.542724:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11525:x1874682172227840:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787836538.542800:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.542842:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.542853:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.542892:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.542906:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 18 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836538.542920:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193196800:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836538.543021:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec840 going to sleep for 11 seconds 00000100:00100000:3.0:1787836538.552343:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193196800:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836538.552373:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836538.552912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.553104:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172227968 00000100:00100000:1.0:1787836538.553113:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172227968 00010000:00010000:1.0:1787836538.553150:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 19 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836538.553187:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:1.0:1787836538.553197:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8602050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+19:2363:x1874682172227968:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836538.553212:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836538.553218:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 19 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.553232:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 19 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.553255:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab80b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee12e expref: 19 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.553270:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:1.0:1787836538.553286:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.553297:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.553313:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.553339:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836538.553389:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8602050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2363:x1874682172227968:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 192us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836538.553396:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00010000:00010000:3.0:1787836538.553455:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.553465:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.553495:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.553502:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.553516:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.553522:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836538.553527:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.553534:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.553546:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:3.0:1787836538.553589:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787836538.553593:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.553599:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab80f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836538.553662:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172227840:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 Request processed in 10939us (11135us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787836538.553670:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 185 00000100:00100000:2.0:1787836538.557271:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.557379:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172228096 00000100:00100000:1.0:1787836538.557390:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172228096 00000100:00100000:1.0:1787836538.557456:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:1.0:1787836538.557466:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172228096:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787836538.557512:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.557533:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.557554:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836538.557558:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787836538.557563:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.557599:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.557624:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 8 pid: 6693 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836538.557651:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c1327840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193196928:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836538.557930:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836538.567461:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c1327840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193196928:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836538.567492:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836538.571443:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.571868:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172228224 00000100:00100000:1.0:1787836538.571878:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172228224 00010000:00010000:1.0:1787836538.571925:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 9 pid: 6693 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836538.571972:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:1.0:1787836538.571982:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172228224:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836538.571998:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836538.572024:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 9 pid: 6693 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.572039:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 9 pid: 6693 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.572089:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab80e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee14a expref: 9 pid: 6693 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.572107:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787836538.572124:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787836538.572131:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.572142:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.572177:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836538.572244:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2363:x1874682172228224:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 263us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836538.572253:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00010000:00010000:3.0:1787836538.572326:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.572339:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.572368:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.572384:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.572393:0:10087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.572401:0:10087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836538.572406:0:10087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.572416:0:10087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.572429:0:10087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.572437:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bd5fa0a/0x966835ea68ab80f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836538.572488:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172228096:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 15023us (15228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836538.572496:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:2.0:1787836538.589234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.590165:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172228480 00000100:00100000:1.0:1787836538.590180:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172228480 00000100:00100000:1.0:1787836538.590254:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 186 00000100:00100000:1.0:1787836538.590265:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+17:11525:x1874682172228480:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787836538.590397:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.590419:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.590435:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.590682:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.590695:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.590719:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.590765:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.590780:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 18 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836538.590793:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c1327840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193197056:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836538.590888:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836538.599911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836538.600120:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172228608 00000100:00100000:0.0:1787836538.600131:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172228608 00010000:00010000:0.0:1787836538.600185:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 19 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836538.600236:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:0.0:1787836538.600247:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5f9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:2364:x1874682172228608:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836538.600278:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836538.600286:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 19 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.600300:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 19 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.600324:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:0.0:1787836538.600330:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.600340:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.600348:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.600376:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836538.600444:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5f9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:2364:x1874682172228608:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 199us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836538.600452:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00010000:00010000:3.0:1787836538.600612:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e400/0x966835ea68ab80c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee135 expref: 18 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836538.600640:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c1327840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193197056:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836538.600661:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.600670:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836538.600675:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787836538.600957:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787836538.601153:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787836538.601206:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787836538.601291:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fb8780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874682193197184:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787836538.601352:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836538.601535:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec480 going to sleep for 11 seconds 00000100:00100000:0.0:1787836538.608395:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193197184 00000100:00100000:0.0:1787836538.608411:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193197184 00000100:00100000:0.0:1787836538.608526:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787836538.608535:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874682193197184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787836538.608678:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874682193197184:12345-0@lo:1000:mdt00_002.0 Request processed in 144us (7325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836538.608686:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787836538.608745:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787836538.608752:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e3eeaf0f00, transno 4294967315 00000100:00100000:0.0:1787836538.608767:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fb8780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874682193197184:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787836538.609329:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787836538.609423:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604e580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874682193197312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787836538.609488:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836538.609510:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1912900 going to sleep for 11 seconds 00000100:00100000:0.0:1787836538.609703:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193197312 00000100:00100000:0.0:1787836538.609709:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193197312 00000100:00100000:0.0:1787836538.609736:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787836538.609744:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1874682193197312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787836538.609910:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874682193197312:12345-0@lo:1000:mdt00_002.0 Request processed in 166us (421us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787836538.609917:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787836538.609957:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604e580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874682193197312:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787836538.610001:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610012:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610021:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610027:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836538.610032:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610040:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610094:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d8034f00) 00010000:00010000:0.0:1787836538.610098:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787836538.610103:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610110:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab8105 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610145:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610152:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610158:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610163:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836538.610166:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610171:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610178:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034400) 00010000:00010000:0.0:1787836538.610181:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787836538.610183:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610188:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab803a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610219:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610232:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610241:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610269:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.610282:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 21 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836538.610294:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3ee9ede00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193197440:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836538.610356:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d050e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836538.616477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.616504:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172228736 00000100:00100000:1.0:1787836538.616512:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172228736 00000100:00100000:0.0:1787836538.616611:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3ee9ede00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193197440:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836538.616639:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.617400:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 22 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836538.617503:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:1.0:1787836538.617518:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+22:2363:x1874682172228736:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836538.617619:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836538.617629:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 22 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.617644:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 22 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.617686:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee119 expref: 22 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.617702:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034400) 00010000:00010000:1.0:1787836538.617708:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.617812:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.617821:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.617859:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836538.617870:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.617877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.617890:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.617905:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.617911:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.617917:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e600 already unused, calling callback (ffffffffc1fe74f0) 00000100:00100000:1.0:1787836538.617920:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+21:2363:x1874682172228736:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 408us (1454us total) trans 0 rc 0/0 00010000:00010000:0.0:1787836538.617921:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836538.617928:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00010000:00010000:0.0:1787836538.617929:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.617937:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034400) 00010000:00010000:0.0:1787836538.617940:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836538.617943:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.617949:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab810c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.621305:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.621326:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.621334:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.621340:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836538.621360:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.621370:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.621389:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034400) 00010000:00010000:0.0:1787836538.621393:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787836538.621397:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.621404:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab80fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836538.621722:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11525:x1874682172228480:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 31451us (32500us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787836538.621736:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 186 00000020:00080000:0.0:1787836538.621742:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787836538.623689:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787836538.623701:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787836538.624300:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787836538.624312:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787836538.629799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836538.630402:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172228992 00000100:00100000:1.0:1787836538.630414:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172228992 00000100:00100000:1.0:1787836538.630478:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:1.0:1787836538.630489:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11525:x1874682172228992:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787836538.631216:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787836538.631476:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787836538.631526:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.631542:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.631565:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.631574:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.631581:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.631588:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836538.631606:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787836538.631702:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+22:11525:x1874682172228992:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 1212us (1911us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787836538.631774:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000020:00080000:1.0:1787836538.631780:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787836538.632829:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836538.632838:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.632848:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836538.632852:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.632862:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.632878:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:0.0:1787836538.632892:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787836538.632897:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.632904:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836538.632926:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836538.632928:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836538.632930:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836539.054583:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836540.078245:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836540.656375:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193197568:0@lo:400:kworker.0 00000100:00100000:0.0:1787836540.656477:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836540.656534:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193198080:0@lo:400:kworker.0 00000100:00100000:0.0:1787836540.656565:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836540.656692:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193197568 00000100:00100000:2.0:1787836540.656699:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193197568 00000100:00100000:2.0:1787836540.656743:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787836540.656751:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193197568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836540.656797:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193197568:12345-0@lo:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836540.656804:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787836540.657094:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193197568:0@lo:400:kworker.0 00000100:00100000:0.0:1787836540.657111:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787836540.657120:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193197952:0@lo:400:kworker.0 00000100:00100000:0.0:1787836540.657151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836540.657186:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193198080 00000100:00100000:0.0:1787836540.657190:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193198080 00000100:00100000:0.0:1787836540.657233:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787836540.657240:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193198080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836540.657280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193198080:12345-0@lo:400:kworker.0 Request processed in 40us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836540.657286:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1787836540.657307:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836540.657333:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193198080:0@lo:400:kworker.0 00000100:00100000:2.0:1787836540.657433:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193197952 00000100:00100000:2.0:1787836540.657437:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193197952 00000100:00100000:2.0:1787836540.657481:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787836540.657488:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193197952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836540.657524:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193197952:12345-0@lo:400:kworker.0 Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836540.657530:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1787836540.657867:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787836540.657893:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193197952:0@lo:400:kworker.0 00000100:00100000:3.0:1787836540.658199:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193197824:0@lo:400:kworker.0 00000100:00100000:3.0:1787836540.658241:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836540.658277:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787836540.658284:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193197696:0@lo:400:kworker.0 00000100:00100000:3.0:1787836540.658309:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836540.658326:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193198208:0@lo:400:kworker.0 00000100:00100000:3.0:1787836540.658348:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836540.658377:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193198208 00000100:00100000:3.0:1787836540.658382:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193198208 00000100:00100000:0.0:1787836540.658619:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193197824 00000100:00100000:0.0:1787836540.658624:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193197824 00000100:00100000:0.0:1787836540.658658:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193197696 00000100:00100000:0.0:1787836540.658661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193197696 00000100:00100000:0.0:1787836540.658678:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787836540.658686:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193197824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836540.658736:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193197824:12345-0@lo:400:kworker.0 Request processed in 52us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836540.658743:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787836540.658758:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787836540.658764:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1327840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193197696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836540.658792:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1327840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193197696:12345-0@lo:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836540.658797:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787836540.658830:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193197696:0@lo:400:kworker.0 00000100:00100000:0.0:1787836540.658843:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193197824:0@lo:400:kworker.0 00000100:00080000:0.0:1787836540.658866:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787836540.658870:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787836540.658993:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787836540.659002:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3b83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193198208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836540.659252:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3b83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193198208:12345-0@lo:400:kworker.0 Request processed in 251us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836540.659258:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787836540.664249:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193198208:0@lo:400:kworker.0 00000040:00080000:1.0:1787836540.703961:0:12469:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836540.703972:0:12469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836540.704011:0:12469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787836540.704018:0:12469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787836540.893529:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836540.893718:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172229248 00000100:00100000:3.0:1787836540.893729:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172229248 00000100:00100000:3.0:1787836540.893816:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 187 00000100:00100000:3.0:1787836540.893827:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+22:11543:x1874682172229248:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836540.893854:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836540.893875:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab811a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee151 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836540.894179:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab8121 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836540.894195:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab8121 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836540.894208:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab8121 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836540.894219:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787836540.894399:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab811a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee151 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836540.894431:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab8121 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee151 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836540.894440:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836540.894443:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787836540.894455:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a000, rc 0) 00000100:00100000:3.0:1787836540.894522:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+24:11543:x1874682172229248:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 695us (1001us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787836540.894530:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 187 00000100:00080000:1.0:1787836540.895777:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836540.935731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836540.937003:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172229376 00000100:00100000:1.0:1787836540.937032:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172229376 00000100:00100000:1.0:1787836540.937131:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:1.0:1787836540.937142:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+24:11543:x1874682172229376:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:1.0:1787836540.937232:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.937269:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.937283:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.937302:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.937309:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.937316:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.941772:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.941795:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.941810:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836540.941865:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.941880:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943124:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943146:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943153:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836540.943157:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943167:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943182:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836540.943186:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836540.943190:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943197:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab812f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943212:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943219:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943225:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943230:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836540.943234:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943250:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943260:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d1431700) 00010000:00010000:1.0:1787836540.943263:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836540.943267:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943274:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943291:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943298:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943304:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943310:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836540.943313:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943319:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943327:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:1.0:1787836540.943330:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836540.943333:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836540.943349:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab813d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836540.944251:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+24:11543:x1874682172229376:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 7102us (8520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836540.944263:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 188 00000100:00100000:3.0:1787836541.043185:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.043451:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172229632 00000100:00100000:0.0:1787836541.043464:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172229632 00000100:00100000:0.0:1787836541.043539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:0.0:1787836541.043550:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+24:11546:x1874682172229632:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836541.043587:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836541.043610:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab8144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee158 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.043683:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.043698:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.043709:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.043723:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.043730:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.043737:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044137:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044148:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044155:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836541.044165:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787836541.044263:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044271:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044278:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044284:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836541.044288:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044295:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044308:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:0.0:1787836541.044311:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836541.044315:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044321:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab814b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044334:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044340:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044357:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044362:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836541.044372:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044379:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044388:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836541.044390:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836541.044393:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.044399:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.044509:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e600/0x966835ea68ab8144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.044526:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.044533:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:1.0:1787836541.044535:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836541.044537:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3f600, rc 0) 00000100:00100000:1.0:1787836541.044606:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+26:11546:x1874682172229632:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1057us (1435us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787836541.044614:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 189 00000100:00100000:2.0:1787836541.048494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.048872:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172229760 00000100:00100000:0.0:1787836541.048883:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172229760 00000100:00100000:0.0:1787836541.048985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:0.0:1787836541.048997:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+26:11546:x1874682172229760:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1787836541.049106:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049124:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049136:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049161:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049168:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049192:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049198:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836541.049203:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049210:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049223:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836541.049226:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787836541.049230:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.049237:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836541.052202:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+26:11546:x1874682172229760:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 3194us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836541.052218:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 190 00000100:00100000:1.0:1787836541.061792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.066276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172230016 00000100:00100000:0.0:1787836541.066293:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172230016 00000100:00100000:0.0:1787836541.066381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:0.0:1787836541.066391:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+26:11546:x1874682172230016:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1787836541.067696:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+27:11546:x1874682172230016:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 1300us (5908us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787836541.067707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00010000:00010000:0.0:1787836541.104003:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836541.116107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836541.116249:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172230272 00000100:00100000:2.0:1787836541.116259:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172230272 00000100:00100000:2.0:1787836541.116321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 191 00000100:00100000:2.0:1787836541.116331:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+27:11071:x1874682172230272:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836541.116367:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836541.116388:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab816e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee15f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.116509:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.116524:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.116546:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.116581:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.116607:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 28 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836541.116621:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193198336:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836541.117704:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e96683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836541.128000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.128104:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172230400 00000100:00100000:0.0:1787836541.128113:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172230400 00010000:00010000:0.0:1787836541.128158:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 29 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836541.128201:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:0.0:1787836541.128211:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+29:2363:x1874682172230400:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836541.128228:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836541.128235:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 29 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.128248:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 29 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.128275:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836541.128280:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.128290:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.128298:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.128317:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836541.128376:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+29:2363:x1874682172230400:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 166us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836541.128384:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 73 00010000:00010000:2.0:1787836541.128615:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f600/0x966835ea68ab8159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee158 expref: 28 pid: 5841 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836541.128636:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193198336:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836541.128657:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.128665:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.128672:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836541.128691:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787836541.129296:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab816e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.129331:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.129340:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:2.0:1787836541.129344:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787836541.129347:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a000, rc 0) 00000100:00100000:2.0:1787836541.129477:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+28:11071:x1874682172230272:12345-192.168.203.25@tcp:101:bash.0 Request processed in 13146us (13436us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787836541.129485:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 191 00000100:00100000:1.0:1787836541.133002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.133163:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172230656 00000100:00100000:0.0:1787836541.133172:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172230656 00000100:00100000:0.0:1787836541.133222:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 192 00000100:00100000:0.0:1787836541.133231:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d144a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+28:11071:x1874682172230656:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:0.0:1787836541.133549:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.133566:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.133577:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787836541.133840:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787836541.133868:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8e79b52 reply state 0000000022e5d4a0 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836541.133877:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787836541.133924:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787836541.134053:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d144a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+32:11071:x1874682172230656:12345-192.168.203.25@tcp:36:bash.0 Request processed in 812us (1049us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787836541.134080:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 192 00000020:00080000:0.0:1787836541.134087:0:10086:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787836541.139204:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.139223:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.139231:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.139256:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836541.139261:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.139269:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.139287:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836541.139290:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836541.139294:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.139300:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f200/0x966835ea68ab8183 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836541.144924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836541.145381:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172230784 00000100:00100000:3.0:1787836541.145392:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172230784 00000100:00100000:3.0:1787836541.145455:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 193 00000100:00100000:3.0:1787836541.145465:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+31:11071:x1874682172230784:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836541.145489:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836541.145509:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab818a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee166 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.145574:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab818a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee166 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.145604:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab818a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee166 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.145627:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:3.0:1787836541.145631:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836541.145635:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b600, rc 0) 00000100:00100000:3.0:1787836541.145717:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+32:11071:x1874682172230784:12345-192.168.203.25@tcp:101:bash.0 Request processed in 253us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836541.145726:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 193 00000100:00100000:1.0:1787836541.161636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836541.161929:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172230912 00000100:00100000:2.0:1787836541.161939:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172230912 00000100:00100000:2.0:1787836541.162034:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:2.0:1787836541.162074:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee50e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:11071:x1874682172230912:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836541.162095:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836541.162117:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee16d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787836541.162145:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a903878, atime: 0x6a903876, ctime: 0x6a903878, blocks: 0xb 00010000:00010000:2.0:1787836541.162170:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1787836541.162177:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836541.162186:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.162216:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.162252:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a800, rc 0) 00000100:00100000:2.0:1787836541.162321:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee50e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+8:11071:x1874682172230912:12345-192.168.203.25@tcp:101:bash.0 Request processed in 277us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836541.162328:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00080000:1.0:1787836541.162758:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836541.164576:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836541.165005:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172231040 00000100:00100000:3.0:1787836541.165016:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172231040 00002000:00010000:2.0:1787836541.165514:0:6697:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787836541.165520:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401f96940 with x1874682172231040 ext(0->18446744073709551615) 00002000:00010000:2.0:1787836541.165533:0:6697:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e401f96940. 00000100:00100000:2.0:1787836541.165622:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:2.0:1787836541.165633:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172231040:12345-192.168.203.25@tcp:10:bash.0 00002000:00010000:2.0:1787836541.165975:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787836541.165980:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787836536 -> 1787836540 00002000:00010000:2.0:1787836541.165982:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787836534 -> 1787836534 00002000:00010000:2.0:1787836541.165985:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787836536 -> 1787836540 00002000:00010000:2.0:1787836541.165988:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787836541.166178:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2364:x1874682172231040:12345-192.168.203.25@tcp:10:bash.0 Request processed in 545us (1610us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787836541.166186:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00002000:00010000:2.0:1787836541.166191:0:6697:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787836541.166194:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e401f96940 with x1874682172231040 ext(0->18446744073709551615) 00002000:00010000:2.0:1787836541.166209:0:6697:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e401f96940. 00000100:00100000:1.0:1787836541.166928:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193198464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836541.166992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836541.167444:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193198464 00000100:00100000:2.0:1787836541.167452:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193198464 00000100:00100000:2.0:1787836541.167642:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787836541.167653:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193198464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836541.167694:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836541.167758:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193198464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836541.167766:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787836541.167845:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193198464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836541.375958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836541.376238:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172231168 00000100:00100000:1.0:1787836541.376248:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172231168 00000100:00100000:1.0:1787836541.376307:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 194 00000100:00100000:1.0:1787836541.376317:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+32:11560:x1874682172231168:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:1.0:1787836541.376396:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376414:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376425:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376439:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376445:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376451:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376876:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376887:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376894:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836541.376939:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376950:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376957:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376963:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376969:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836541.376973:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376980:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.376993:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836541.376996:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836541.377001:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377007:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377260:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377267:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377279:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377284:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836541.377288:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377294:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377302:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d1431500) 00010000:00010000:1.0:1787836541.377305:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836541.377308:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377313:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab819f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377328:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377334:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377473:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377478:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836541.377481:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377497:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377505:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:1.0:1787836541.377508:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836541.377511:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.377516:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab81a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836541.377700:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+32:11560:x1874682172231168:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 1372us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836541.377710:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 194 00000100:00100000:1.0:1787836541.439153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836541.439304:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172231424 00000100:00100000:2.0:1787836541.439314:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172231424 00000100:00100000:2.0:1787836541.439379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 195 00000100:00100000:2.0:1787836541.439389:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+32:11563:x1874682172231424:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836541.439410:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836541.439430:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab81ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee174 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.439502:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.439515:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.439526:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.439540:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.439547:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.439553:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.439895:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab81c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440117:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab81c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440126:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab81c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836541.440136:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787836541.440225:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440233:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440239:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440245:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836541.440249:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440256:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440268:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836541.440271:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836541.440275:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440293:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab81b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440307:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440313:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440319:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440324:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836541.440327:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440333:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440341:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d8034c00) 00010000:00010000:2.0:1787836541.440343:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836541.440346:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440352:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab81bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440394:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab81ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee174 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440407:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab81c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee174 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.440421:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:2.0:1787836541.440423:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787836541.440426:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005be00, rc 0) 00000100:00100000:2.0:1787836541.440498:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+34:11563:x1874682172231424:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1109us (1355us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787836541.440505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 195 00000100:00100000:3.0:1787836541.445434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.445618:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172231552 00000100:00100000:0.0:1787836541.445628:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172231552 00000100:00100000:0.0:1787836541.445692:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 196 00000100:00100000:0.0:1787836541.445703:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+34:11563:x1874682172231552:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:0.0:1787836541.445772:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.445790:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.445799:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.445832:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.445858:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 34 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836541.445872:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3ee9ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193198592:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836541.445977:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1912900 going to sleep for 11 seconds 00000100:00100000:0.0:1787836541.448642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836541.451129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172231808 00000100:00100000:3.0:1787836541.451144:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172231808 00000100:00100000:3.0:1787836541.451227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:3.0:1787836541.451238:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+35:5599:x1874682172231808:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787836541.451597:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+36:5599:x1874682172231808:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 359us (2964us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787836541.451605:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:3.0:1787836541.455559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.455704:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172231936 00000100:00100000:0.0:1787836541.455715:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172231936 00010000:00010000:0.0:1787836541.455755:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 36 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836541.455794:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:0.0:1787836541.455803:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+36:2363:x1874682172231936:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836541.455821:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836541.455827:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 36 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.455840:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 36 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.455861:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836541.455866:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.455875:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.455899:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.455928:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836541.455990:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+36:2363:x1874682172231936:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 187us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836541.455998:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 74 00010000:00010000:1.0:1787836541.458429:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8175 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee15f expref: 35 pid: 5843 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836541.458453:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3ee9ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193198592:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836541.458476:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458486:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458491:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458519:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458542:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458550:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458556:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836541.458560:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458568:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458581:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:1.0:1787836541.458584:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836541.458589:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.458594:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836541.458673:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+34:11563:x1874682172231552:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 12971us (13249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836541.458682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 196 00000100:00100000:3.0:1787836541.461958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.462464:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172232192 00000100:00100000:0.0:1787836541.462474:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172232192 00000100:00100000:0.0:1787836541.462531:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1787836541.462541:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+34:11563:x1874682172232192:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1787836541.462800:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+35:11563:x1874682172232192:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 260us (851us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787836541.462809:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:2.0:1787836541.545613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836541.545663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836541.545822:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172232320 00000100:00100000:3.0:1787836541.545831:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172232320 00002000:00100000:3.0:1787836541.545882:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff98e2c27ead00 x1874682172232320/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:327/0 lens 496/0 e 0 to 0 dl 1787836552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787836541.545893:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e2c27ead00 with x1874682172232320 ext(0->7) 00002000:00010000:3.0:1787836541.545898:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e2c27ead00 00000100:00100000:3.0:1787836541.545938:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:3.0:1787836541.545947:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172232320:12345-192.168.203.25@tcp:4:bash.0 00000100:00100000:0.0:1787836541.546100:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172232448 00000100:00100000:0.0:1787836541.546105:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172232448 00000100:00100000:0.0:1787836541.546140:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:0.0:1787836541.546150:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+10:2363:x1874682172232448:12345-192.168.203.25@tcp:16:kworker.0 00000100:00100000:3.0:1787836541.546435:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+12:2363:x1874682172232320:12345-192.168.203.25@tcp:4:bash.0 Request processed in 487us (769us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787836541.546443:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00002000:00100000:3.0:1787836541.546451:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff98e2c27ead00 x1874682172232320/t4294967319(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:327/0 lens 496/448 e 0 to 0 dl 1787836552 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787836541.546459:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e2c27ead00 with x1874682172232320 ext(0->7) 00002000:00010000:3.0:1787836541.546463:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e2c27ead00 00000100:00100000:2.0:1787836541.630722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.630784:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172232704 00000100:00100000:0.0:1787836541.630798:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172232704 00000100:00100000:0.0:1787836541.630855:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 197 00000100:00100000:0.0:1787836541.630864:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+35:11574:x1874682172232704:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:0.0:1787836541.630890:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836541.630910:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee17b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.631005:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.631107:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.631120:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.631135:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.631142:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.631148:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836541.631314:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1787836541.631570:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:1.0:1787836541.631581:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00010000:00010000:0.0:1787836541.631916:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab81ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.631927:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab81ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.631935:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab81ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836541.631948:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787836541.632225:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632233:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632248:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632254:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ec00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836541.632257:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632263:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632274:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:0.0:1787836541.632277:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836541.632281:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632287:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ec00/0x966835ea68ab81de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632301:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632307:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632312:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632317:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836541.632320:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632768:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632779:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d81a4400) 00010000:00010000:0.0:1787836541.632781:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836541.632785:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632791:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab81e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632845:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee17b expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632858:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab81ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee17b expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.632865:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836541.632867:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836541.632869:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3f800, rc 0) 00000100:00100000:2.0:1787836541.632927:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172232448:12345-192.168.203.25@tcp:16:kworker.0 Request processed in 86778us (87322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836541.632939:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:0.0:1787836541.633161:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+37:11574:x1874682172232704:12345-192.168.203.25@tcp:101:cat.0 Request processed in 2298us (2451us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787836541.633168:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 197 00000100:00100000:0.0:1787836541.642258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836541.642340:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172232960 00000100:00100000:1.0:1787836541.642351:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172232960 00000100:00100000:1.0:1787836541.642402:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1787836541.642437:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+37:11574:x1874682172232960:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:1.0:1787836541.642664:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+38:11574:x1874682172232960:12345-192.168.203.25@tcp:35:cat.0 Request processed in 229us (414us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787836541.642672:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:2.0:1787836541.701422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836541.708292:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172233216 00000100:00100000:0.0:1787836541.708310:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172233216 00000100:00100000:0.0:1787836541.708391:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 198 00000100:00100000:0.0:1787836541.708402:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+38:11575:x1874682172233216:12345-192.168.203.25@tcp:36:rm.0 00010000:00010000:0.0:1787836541.708693:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787836541.708724:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab81ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee17b expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.708748:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab81c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee174 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.708773:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab818a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee166 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.708785:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d81a4000) 00010000:00010000:0.0:1787836541.708797:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836541.708817:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.708832:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.708842:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.708854:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.708860:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836541.708867:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.711813:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.711877:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.711893:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836541.712990:0:10086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787836541.713004:0:10086:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390145945251ns, next at 391145941851ns, rc = 0 00010000:00010000:2.0:1787836541.713116:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713130:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713148:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713157:0:10086:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713165:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713171:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713191:0:10086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787836541.713215:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713222:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713227:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713307:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836541.713311:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713320:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713332:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034300) 00010000:00010000:2.0:1787836541.713336:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787836541.713347:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713354:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab8208 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713375:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713382:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713388:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713394:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836541.713396:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713403:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713412:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836541.713415:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836541.713418:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713424:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f400/0x966835ea68ab81fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836541.713436:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039c4758d reply state 00000000f5421167 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836541.713458:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787836541.713618:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+37:11575:x1874682172233216:12345-192.168.203.25@tcp:36:rm.0 Request processed in 5162us (12154us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787836541.713627:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 198 00010000:00010000:2.0:1787836541.713932:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836541.713939:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713945:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836541.713949:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713955:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713964:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98e3d8034300) 00010000:00010000:2.0:1787836541.713967:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787836541.713970:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713975:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab820f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.713991:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836541.713993:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836541.713995:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836541.716753:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.716835:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.716855:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.716862:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836541.716867:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.716875:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.717368:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d81a4700) 00010000:00010000:2.0:1787836541.717373:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836541.717380:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.717388:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e200/0x966835ea68ab8201 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836541.775304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836541.775579:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172233472 00000100:00100000:1.0:1787836541.775590:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172233472 00000100:00100000:1.0:1787836541.775656:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 199 00000100:00100000:1.0:1787836541.775668:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeace580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+36:11581:x1874682172233472:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836541.775692:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836541.775713:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8216 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee182 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.775838:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.775854:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.775866:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.775880:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.775887:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.775893:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836541.776473:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787836541.776631:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776642:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776650:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776684:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776691:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776698:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776703:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836541.776707:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776714:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776726:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836541.776728:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836541.776733:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776750:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab821d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836541.776762:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6f8050d reply state 000000004751a5a0 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836541.776770:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787836541.776798:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab8216 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776812:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.776820:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431700) 00010000:00010000:1.0:1787836541.776822:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836541.776824:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5800, rc 0) 00000100:00100000:1.0:1787836541.776899:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeace580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+39:11581:x1874682172233472:12345-192.168.203.25@tcp:101:bash.0 Request processed in 1233us (1604us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787836541.776907:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 199 00010000:00010000:3.0:1787836541.778628:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.778662:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.778670:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.778676:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836541.778680:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.778688:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.778707:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d1431500) 00010000:00010000:3.0:1787836541.778710:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836541.778716:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836541.778723:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8224 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836541.783515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836541.785031:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172233600 00000100:00100000:2.0:1787836541.785128:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172233600 00000100:00100000:2.0:1787836541.785250:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:2.0:1787836541.785261:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2364:x1874682172233600:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836541.785280:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836541.785300:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee189 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836541.785327:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00002000:00010000:2.0:1787836541.785328:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787836541.785350:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1787836541.785369:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836541.785381:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.785920:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.785938:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836541.786019:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172233600:12345-192.168.203.25@tcp:101:bash.0 Request processed in 760us (2515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836541.786028:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00080000:0.0:1787836541.787503:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787836541.790873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836541.790992:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172233728 00000100:00100000:2.0:1787836541.791003:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172233728 00000100:00100000:2.0:1787836541.791159:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:2.0:1787836541.791169:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+6:11581:x1874682172233728:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:2.0:1787836541.791188:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836541.791230:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee190 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.791265:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.791275:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836541.791279:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836541.791285:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.791343:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.791357:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 7 pid: 6693 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836541.791374:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1874682193198720:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836541.791479:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d07bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836541.794561:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1874682193198720:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836541.794605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00010000:00010000:2.0:1787836541.794610:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836541.794632:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836541.794696:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:11581:x1874682172233728:12345-192.168.203.25@tcp:101:bash.0 Request processed in 3528us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836541.794705:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:1.0:1787836541.794804:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172233856 00000100:00100000:1.0:1787836541.794812:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172233856 00010000:00010000:1.0:1787836541.794850:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 7 pid: 6693 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836541.794893:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:1.0:1787836541.794903:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172233856:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836541.794934:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836541.794957:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 7 pid: 6693 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.794970:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 7 pid: 6693 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.794994:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e96f93aa/0x966835ea68ab8239 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee189 expref: 7 pid: 6693 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.795009:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836541.795013:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836541.795020:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.795030:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836541.795111:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836541.795125:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401f94780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1874682193198848:192.168.203.25@tcp:105: 00000100:00100000:1.0:1787836541.795195:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836541.804624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836541.804762:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401f94780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1874682193198848:192.168.203.25@tcp:105: 00010000:00010000:1.0:1787836541.804791:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836541.804869:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2364:x1874682172233856:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 9966us (10266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836541.804881:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:2.0:1787836541.806278:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172234112 00000100:00100000:2.0:1787836541.806297:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172234112 00000100:00100000:2.0:1787836541.806429:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:2.0:1787836541.806441:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+38:11581:x1874682172234112:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:2.0:1787836541.806861:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+39:11581:x1874682172234112:12345-192.168.203.25@tcp:35:bash.0 Request processed in 421us (2246us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787836541.806870:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:0.0:1787836542.022260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.022391:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172234240 00000100:00100000:2.0:1787836542.022411:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172234240 00000100:00100000:2.0:1787836542.022492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 200 00000100:00100000:2.0:1787836542.022503:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+39:11597:x1874682172234240:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836542.022528:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836542.022552:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8247 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee197 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.022635:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab824e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.022652:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab824e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.022665:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab824e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836542.022725:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787836542.022730:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836542.022753:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab824e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.022779:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8247 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee197 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.022798:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab824e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee197 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.022807:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836542.022811:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836542.022829:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b800, rc 0) 00000100:00100000:2.0:1787836542.022904:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+40:11597:x1874682172234240:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 403us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.022911:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 200 00000100:00080000:0.0:1787836542.023754:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836542.026460:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836542.026621:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172234496 00000100:00100000:0.0:1787836542.026631:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172234496 00000100:00100000:0.0:1787836542.026696:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 201 00000100:00100000:0.0:1787836542.026707:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+40:11597:x1874682172234496:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836542.026730:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836542.026750:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8255 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee19e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836542.026869:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab825c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836542.026885:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab825c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836542.026898:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab825c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836542.026909:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787836542.027334:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3e000/0x966835ea68ab8255 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee19e expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836542.027353:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab825c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee19e expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836542.027373:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431700) 00010000:00010000:0.0:1787836542.027376:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836542.027380:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3fe00, rc 0) 00000100:00100000:0.0:1787836542.027481:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+42:11597:x1874682172234496:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 775us (1029us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787836542.027489:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 201 00000100:00100000:3.0:1787836542.031091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.031325:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172234752 00000100:00100000:2.0:1787836542.031335:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172234752 00000100:00100000:2.0:1787836542.031394:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 202 00000100:00100000:2.0:1787836542.031505:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeacda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+42:11597:x1874682172234752:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836542.031533:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836542.031553:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab826a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.031651:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab8271 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.031666:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab8271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.031677:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab8271 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836542.031689:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787836542.031802:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab826a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1a5 expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.031819:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab8271 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1a5 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.031828:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431700) 00010000:00010000:2.0:1787836542.031844:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787836542.031848:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005aa00, rc 0) 00000100:00100000:2.0:1787836542.031908:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeacda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+44:11597:x1874682172234752:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 406us (848us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787836542.034455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.034547:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172234880 00000100:00100000:3.0:1787836542.034558:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172234880 00000100:00100000:3.0:1787836542.034643:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:3.0:1787836542.034654:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+45:2364:x1874682172234880:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836542.034685:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836542.034712:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fe00/0x966835ea68ab825c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee19e expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.034732:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431700) 00010000:00010000:3.0:1787836542.034737:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836542.034790:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+44:2364:x1874682172234880:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 138us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.034798:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1787836542.036974:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 202 00000100:00100000:1.0:1787836542.041611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.041692:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172235008 00000100:00100000:2.0:1787836542.041701:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172235008 00000100:00100000:2.0:1787836542.041759:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:2.0:1787836542.041770:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+6:2362:x1874682172235008:12345-192.168.203.25@tcp:1:lfs.0 00010000:00010000:2.0:1787836542.041814:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.041834:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.041844:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836542.041848:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836542.041852:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.041887:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.041901:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 6 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836542.041915:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1874682193198976:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836542.042023:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836542.045561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.045821:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1874682193198976:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836542.045852:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.045918:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172235136 00000100:00100000:1.0:1787836542.045925:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172235136 00002000:00100000:1.0:1787836542.045978:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98e3ee9ec3c0 x1874682172235136/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:328/0 lens 504/0 e 0 to 0 dl 1787836553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787836542.045989:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3ee9ec3c0 with x1874682172235136 ext(0->8) 00010000:00010000:1.0:1787836542.045996:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 7 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.046011:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 7 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787836542.046019:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e3ee9ec3c0 00000100:00100000:1.0:1787836542.046121:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:1.0:1787836542.046131:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172235136:12345-192.168.203.25@tcp:4:lfs.0 00000100:00100000:1.0:1787836542.046760:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172235136:12345-192.168.203.25@tcp:4:lfs.0 Request processed in 628us (1207us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787836542.046766:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00002000:00100000:1.0:1787836542.046773:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98e3ee9ec3c0 x1874682172235136/t4294967308(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:328/0 lens 504/448 e 0 to 0 dl 1787836553 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787836542.046780:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3ee9ec3c0 with x1874682172235136 ext(0->8) 00010000:00010000:1.0:1787836542.046785:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 9 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.046799:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 9 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787836542.046804:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98e3ee9ec3c0 00000100:00100000:0.0:1787836542.050106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.050327:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172235264 00000100:00100000:3.0:1787836542.050336:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172235264 00010000:00010000:3.0:1787836542.050378:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 9 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836542.050523:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:3.0:1787836542.050534:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2364:x1874682172235264:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836542.050551:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787836542.050573:0:7631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787836542.050576:0:7631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787836540 00002000:00010000:3.0:1787836542.050578:0:7631:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787836541 00002000:00010000:3.0:1787836542.050580:0:7631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787836540 00010000:00010000:3.0:1787836542.050585:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 9 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.050600:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 9 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.050671:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029fd4bc3/0x966835ea68ab8240 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee190 expref: 9 pid: 6692 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.050689:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836542.050694:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836542.050699:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.050710:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.050744:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836542.050820:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172235264:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 288us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.050832:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 76 00010000:00010000:1.0:1787836542.051305:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.051317:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.051344:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.051352:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.051360:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.051367:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836542.051372:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.051381:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.051412:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.051421:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efce9cef/0x966835ea68ab827f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.051498:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2362:x1874682172235008:12345-192.168.203.25@tcp:1:lfs.0 Request processed in 9728us (9895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836542.051506:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1787836542.054894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.054978:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172235520 00000100:00100000:3.0:1787836542.054988:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172235520 00000100:00100000:3.0:1787836542.055053:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:3.0:1787836542.055096:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+43:11597:x1874682172235520:12345-192.168.203.25@tcp:35:lfs.0 00000004:00010000:3.0:1787836542.055162:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab8271 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1a5 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787836542.055596:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787836542.055649:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787836542.055969:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787836542.056025:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.056264:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.056275:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.056310:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.056325:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 47 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836542.056340:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c198e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874682193199104:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836542.056486:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154780 going to sleep for 11 seconds 00000100:00100000:3.0:1787836542.060816:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c198e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874682193199104:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836542.060851:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836542.061148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836542.061239:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172235648 00000100:00100000:1.0:1787836542.061246:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172235648 00010000:00010000:1.0:1787836542.061287:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 48 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.061331:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:1.0:1787836542.061341:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+48:2364:x1874682172235648:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836542.061360:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836542.061367:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 48 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.061381:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 48 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.061404:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab822b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee182 expref: 48 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.061443:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431700) 00010000:00010000:1.0:1787836542.061449:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.061459:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.061467:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.061499:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836542.061566:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+47:2364:x1874682172235648:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 225us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836542.061573:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 77 00010000:00010000:0.0:1787836542.061757:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836542.061766:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787836542.061910:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787836542.062174:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787836542.063600:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3ee9ed2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193199232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787836542.063876:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836542.063993:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836542.064268:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193199232 00000100:00100000:2.0:1787836542.064278:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193199232 00000100:00100000:2.0:1787836542.064384:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787836542.064395:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1874682193199232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787836542.064496:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1874682193199232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.064503:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787836542.064592:0:5844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787836542.064599:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e3d3dde1c0, transno 4294967307 00000100:00100000:1.0:1787836542.064619:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3ee9ed2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193199232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787836542.066081:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787836542.066168:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193199360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787836542.066294:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836542.066385:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99c00 going to sleep for 11 seconds 00000100:00080000:0.0:1787836542.066462:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836542.066542:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193199360 00000100:00100000:2.0:1787836542.066550:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193199360 00000100:00100000:2.0:1787836542.066712:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787836542.066723:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1874682193199360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787836542.066921:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1874682193199360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 200us (627us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787836542.066930:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836542.067000:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc6d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874682193199360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787836542.067107:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787836542.067153:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.067165:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.067183:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.067189:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836542.067246:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.067255:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.067271:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431700) 00010000:00010000:1.0:1787836542.067275:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787836542.067280:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.067287:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8286 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836542.067463:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787836542.067553:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787836542.067564:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390500505452ns, next at 391500503424ns, rc = 0 00000001:00080000:1.0:1787836542.067571:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787836542.067793:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431700) 00010000:00010000:1.0:1787836542.067796:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787836542.067804:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab8271 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1a5 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.067945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+50:11597:x1874682172235520:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 12853us (13062us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787836542.067964:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000020:00080000:1.0:1787836542.067970:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787836542.071533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836542.071605:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172235776 00000100:00100000:1.0:1787836542.071616:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172235776 00000100:00100000:1.0:1787836542.071680:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 203 00000100:00100000:1.0:1787836542.071691:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+50:11597:x1874682172235776:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836542.071719:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836542.071742:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab828d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1ac expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.071806:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab828d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1ac expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.071822:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab828d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1ac expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.071840:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836542.071844:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787836542.071848:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5800, rc 0) 00000100:00100000:1.0:1787836542.071966:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+51:11597:x1874682172235776:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 276us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836542.071974:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 203 00000100:00100000:0.0:1787836542.075607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.075852:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172236032 00000100:00100000:2.0:1787836542.075861:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172236032 00000100:00100000:2.0:1787836542.075914:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:2.0:1787836542.075922:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+51:11597:x1874682172236032:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1787836542.076990:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+52:11597:x1874682172236032:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 1060us (1386us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787836542.077030:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00010000:00010000:2.0:1787836542.126597:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836542.168520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836542.169819:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172236160 00000100:00100000:1.0:1787836542.169835:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172236160 00000100:00100000:1.0:1787836542.169917:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 204 00000100:00100000:1.0:1787836542.169928:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+52:11607:x1874682172236160:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:1.0:1787836542.170050:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170094:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170106:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170122:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170130:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170137:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170244:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170253:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170260:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836542.170307:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170320:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170336:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170343:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170349:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836542.170355:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170363:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170377:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836542.170380:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836542.170385:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170392:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab8294 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170407:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170413:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170418:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170422:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836542.170432:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170438:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170446:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d1431700) 00010000:00010000:1.0:1787836542.170449:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836542.170451:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170458:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab829b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170473:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170479:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170484:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170489:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836542.170491:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170497:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170504:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836542.170507:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836542.170516:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.170523:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab82a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.170630:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+52:11607:x1874682172236160:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 701us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836542.170641:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 204 00000100:00100000:0.0:1787836542.230183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.230338:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172236416 00000100:00100000:2.0:1787836542.230348:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172236416 00000100:00100000:2.0:1787836542.230407:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 205 00000100:00100000:2.0:1787836542.230417:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+52:11610:x1874682172236416:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836542.230439:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836542.230459:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab82a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1b3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230527:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230541:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230552:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230565:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230571:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230577:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230719:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab82be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230744:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab82be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230751:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab82be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836542.230763:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787836542.230888:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230896:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230903:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230909:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005aa00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836542.230913:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230920:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836542.230937:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836542.230943:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230949:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab82b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230963:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230976:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230981:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230986:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836542.230989:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.230995:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.231002:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d8034800) 00010000:00010000:2.0:1787836542.231005:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836542.231007:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.231014:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.231126:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab82a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1b3 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.231142:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab82be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1b3 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.231149:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836542.231151:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836542.231160:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a000, rc 0) 00000100:00100000:2.0:1787836542.231371:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+54:11610:x1874682172236416:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 954us (1200us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787836542.231380:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 205 00000100:00100000:0.0:1787836542.237023:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.237240:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172236544 00000100:00100000:2.0:1787836542.237252:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172236544 00000100:00100000:2.0:1787836542.237318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 206 00000100:00100000:2.0:1787836542.237327:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+54:11610:x1874682172236544:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:2.0:1787836542.237385:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237399:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237412:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237440:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237447:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237455:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237462:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836542.237466:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237480:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237505:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836542.237508:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836542.237514:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.237521:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836542.237704:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+54:11610:x1874682172236544:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 375us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.237712:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 206 00000100:00100000:2.0:1787836542.241539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.241694:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172236800 00000100:00100000:3.0:1787836542.241705:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172236800 00000100:00100000:3.0:1787836542.241799:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:3.0:1787836542.241811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+54:11610:x1874682172236800:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1787836542.242125:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+55:11610:x1874682172236800:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 314us (597us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787836542.242134:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:0.0:1787836542.380511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836542.380619:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172237056 00000100:00100000:1.0:1787836542.380629:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172237056 00000100:00100000:1.0:1787836542.380696:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 207 00000100:00100000:1.0:1787836542.380707:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+55:11620:x1874682172237056:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836542.380731:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836542.380735:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787836542.380761:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab824e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee197 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.380781:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:1.0:1787836542.380786:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836542.380800:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab82d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1ba expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.380908:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab82da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.380923:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab82da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.380933:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab82da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836542.380958:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787836542.381141:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab82d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1ba expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.381155:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab82da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1ba expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.381163:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836542.381165:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836542.381168:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5000, rc 0) 00000100:00100000:1.0:1787836542.381232:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+56:11620:x1874682172237056:12345-192.168.203.25@tcp:101:bash.0 Request processed in 528us (731us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787836542.381240:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 207 00000100:00100000:1.0:1787836542.397230:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.397355:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172237312 00000100:00100000:2.0:1787836542.397370:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172237312 00000100:00100000:2.0:1787836542.397461:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 208 00000100:00100000:2.0:1787836542.397474:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+56:11620:x1874682172237312:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:2.0:1787836542.397545:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787836542.397589:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5000/0x966835ea68ab82da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1ba expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.397614:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab82be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1b3 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.397627:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836542.397633:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836542.397889:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.397921:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.397932:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787836542.397994:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787836542.398033:0:10086:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d6deacc reply state 00000000765c2463 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836542.398054:0:10086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787836542.398791:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+57:11620:x1874682172237312:12345-192.168.203.25@tcp:36:bash.0 Request processed in 1311us (1566us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787836542.398815:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 208 00000020:00080000:3.0:1787836542.398822:0:10086:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787836542.405771:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.405797:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.405805:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.405812:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836542.405819:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.405828:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.405853:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836542.405857:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836542.405864:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.405896:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.411370:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.411631:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172237440 00000100:00100000:3.0:1787836542.411641:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172237440 00000100:00100000:3.0:1787836542.411703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 209 00000100:00100000:3.0:1787836542.411713:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+56:11620:x1874682172237440:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836542.411737:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836542.411764:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab82ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1c1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.411852:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.411867:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.411878:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836542.411907:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787836542.411911:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836542.411928:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.411954:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab82ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.411973:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.412002:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:3.0:1787836542.412005:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836542.412009:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b200, rc 0) 00000100:00100000:3.0:1787836542.412130:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+57:11620:x1874682172237440:12345-192.168.203.25@tcp:101:bash.0 Request processed in 417us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.412138:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 209 00000100:00100000:3.0:1787836542.415785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.415932:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172237696 00000100:00100000:2.0:1787836542.415944:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172237696 00000100:00100000:2.0:1787836542.416012:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:2.0:1787836542.416023:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+57:11620:x1874682172237696:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:2.0:1787836542.416327:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+58:11620:x1874682172237696:12345-192.168.203.25@tcp:35:bash.0 Request processed in 305us (555us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787836542.416336:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:1.0:1787836542.513571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.513728:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172237824 00000100:00100000:2.0:1787836542.513738:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172237824 00000100:00100000:2.0:1787836542.513804:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 210 00000100:00100000:2.0:1787836542.513814:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+58:11626:x1874682172237824:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836542.513839:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836542.513860:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1c8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.513933:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.513949:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.513961:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836542.514024:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787836542.514052:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836542.514111:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.514141:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab82fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c8 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.514158:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c8 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.514167:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836542.514169:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836542.514172:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a000, rc 0) 00000100:00100000:2.0:1787836542.514240:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11626:x1874682172237824:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 428us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.514247:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 210 00000100:00100000:1.0:1787836542.522028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.522503:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172237952 00000100:00100000:3.0:1787836542.522513:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172237952 00000100:00100000:3.0:1787836542.522569:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 211 00000100:00100000:3.0:1787836542.522577:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11626:x1874682172237952:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836542.522598:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836542.522857:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab830b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1cf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.522920:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.522935:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.522946:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.522961:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.522968:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.522987:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523170:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523178:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523185:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836542.523221:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787836542.523226:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836542.523243:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523255:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523263:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523269:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523276:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523281:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.523286:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523300:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523312:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836542.523315:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836542.523319:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523325:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523338:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523343:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523349:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523355:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.523357:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523363:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523368:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d224a000) 00010000:00010000:3.0:1787836542.523370:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836542.523373:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523387:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523416:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab830b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1cf expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523428:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1cf expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.523435:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:3.0:1787836542.523437:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836542.523439:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a800, rc 0) 00000100:00100000:3.0:1787836542.523545:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11626:x1874682172237952:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 968us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.523551:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 211 00000100:00100000:0.0:1787836542.532239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836542.532290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.532378:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172238336 00000100:00100000:3.0:1787836542.532388:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172238336 00000100:00100000:3.0:1787836542.532461:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:3.0:1787836542.532472:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+60:2363:x1874682172238336:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836542.532490:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836542.532516:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab8320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1cf expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.532538:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:3.0:1787836542.532543:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836542.532623:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+59:2363:x1874682172238336:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 152us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.532661:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:2.0:1787836542.532795:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172238208 00000100:00100000:2.0:1787836542.532799:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172238208 00000100:00100000:2.0:1787836542.532839:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 212 00000100:00100000:2.0:1787836542.532847:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11626:x1874682172238208:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836542.532864:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836542.532880:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab8327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1d6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.532987:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.533003:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.533028:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.533121:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.533137:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 60 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836542.533154:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193199488:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836542.533226:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e567cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836542.537421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.537962:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193199488:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836542.537997:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836542.538147:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172238464 00000100:00100000:3.0:1787836542.538156:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172238464 00010000:00010000:3.0:1787836542.538198:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 61 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836542.538238:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:3.0:1787836542.538248:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+61:2364:x1874682172238464:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836542.538264:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836542.538272:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 61 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.538284:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 61 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.538312:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab82f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c1 expref: 61 pid: 5841 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.538329:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:3.0:1787836542.538335:0:7631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.538345:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.538353:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.541930:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836542.542750:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+60:2364:x1874682172238464:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 4493us (5332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.542778:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 78 00010000:00010000:2.0:1787836542.544433:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.544449:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836542.544474:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787836542.545001:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab8327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.545026:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.545084:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836542.545088:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787836542.545091:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005aa00, rc 0) 00000100:00100000:2.0:1787836542.545166:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11626:x1874682172238208:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 12319us (12938us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787836542.545176:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 212 00000100:00100000:1.0:1787836542.551826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.556878:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172238720 00000100:00100000:3.0:1787836542.556893:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172238720 00000100:00100000:1.0:1787836542.557098:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1787836542.557108:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11626:x1874682172238720:12345-192.168.203.25@tcp:103:lfs.0 00010000:00010000:1.0:1787836542.557122:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836542.557144:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab828d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1ac expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.557162:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836542.557179:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836542.557246:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11626:x1874682172238720:12345-192.168.203.25@tcp:103:lfs.0 Request processed in 139us (5436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836542.557254:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1787836542.564145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.564268:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172238848 00000100:00100000:2.0:1787836542.564277:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172238848 00000100:00100000:2.0:1787836542.564339:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 213 00000100:00100000:2.0:1787836542.564350:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11626:x1874682172238848:12345-192.168.203.25@tcp:58:lfs.0 00010000:00010000:2.0:1787836542.564446:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.564462:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.564474:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836542.564734:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787836542.564833:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11626:x1874682172238848:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 484us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.564841:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 213 00000100:00100000:0.0:1787836542.569554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.569774:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172238976 00000100:00100000:3.0:1787836542.569783:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172238976 00000100:00100000:3.0:1787836542.569842:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 214 00000100:00100000:3.0:1787836542.569852:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+59:11626:x1874682172238976:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836542.569878:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836542.569900:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1dd expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.569957:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.569968:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1dd expref: 60 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.569987:0:10086:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.570000:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1dd expref: 60 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.570014:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:3.0:1787836542.570031:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836542.570046:0:10086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1dd expref: 60 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.570055:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b200, rc 0) 00000100:00100000:3.0:1787836542.570165:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11626:x1874682172238976:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 315us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.570172:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 214 00000040:00080000:0.0:1787836542.702338:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787836542.702349:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787836542.702430:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787836542.702438:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787836542.702610:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193199616:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787836542.702731:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787836542.705838:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836542.705873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193199744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836542.705954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836542.706100:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193199744 00000100:00100000:0.0:1787836542.706111:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193199744 00000100:00100000:0.0:1787836542.706200:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787836542.706212:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193199744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836542.706256:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836542.706313:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193199744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836542.706320:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787836542.706987:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836542.707026:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1787836542.707043:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1787836542.707102:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193199744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836542.713935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.714098:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193199616:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787836542.714509:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172239104 00000100:00100000:3.0:1787836542.714518:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172239104 00000100:00100000:3.0:1787836542.714604:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 215 00000100:00100000:3.0:1787836542.714618:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11627:x1874682172239104:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787836542.714807:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787836542.714997:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11627:x1874682172239104:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 382us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.715005:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 215 00000100:00100000:1.0:1787836542.731292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.731480:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172239232 00000100:00100000:3.0:1787836542.731492:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172239232 00000100:00100000:3.0:1787836542.731562:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 216 00000100:00100000:3.0:1787836542.731573:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11627:x1874682172239232:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787836542.731669:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731687:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731701:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731737:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731745:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731752:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731779:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731787:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731794:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836542.731840:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787836542.731845:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836542.731858:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731870:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731877:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731884:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731901:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.731905:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731913:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731927:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:3.0:1787836542.731930:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836542.731934:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731940:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a800/0x966835ea68ab834a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731955:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731967:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731974:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731979:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.731982:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.731988:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.732006:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff98e3d224a000) 00010000:00010000:3.0:1787836542.732008:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836542.732011:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.732017:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a400/0x966835ea68ab8351 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.732043:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.732049:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.732054:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.738436:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.738446:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.738459:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.738479:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:3.0:1787836542.738481:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836542.738487:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.738493:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152be00/0x966835ea68ab8358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836542.738755:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11627:x1874682172239232:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 7177us (7468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.738768:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 216 00000100:00100000:1.0:1787836542.744901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.745108:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172239488 00000100:00100000:3.0:1787836542.745120:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172239488 00000100:00100000:3.0:1787836542.745194:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 217 00000100:00100000:3.0:1787836542.745208:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+60:11627:x1874682172239488:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836542.745236:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836542.745266:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab835f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745406:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745424:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745438:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836542.745450:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787836542.745586:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745595:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745603:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745626:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13acc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.745631:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745640:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745655:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:3.0:1787836542.745658:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787836542.745664:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745671:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745725:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab835f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1e4 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745736:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:3.0:1787836542.745738:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787836542.745742:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab835f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1e4 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.745764:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b600, rc 0) 00000100:00100000:3.0:1787836542.745853:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+61:11627:x1874682172239488:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 648us (963us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787836542.745862:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 217 00000100:00100000:1.0:1787836542.759873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.759963:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172239616 00000100:00100000:3.0:1787836542.759986:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172239616 00000100:00100000:3.0:1787836542.760052:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 218 00000100:00100000:3.0:1787836542.760101:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+61:11627:x1874682172239616:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787836542.760153:0:10086:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787836542.760257:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+61:11627:x1874682172239616:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 195us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.760265:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 218 00000100:00100000:1.0:1787836542.773199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.773303:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172239872 00000100:00100000:3.0:1787836542.773313:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172239872 00000100:00100000:3.0:1787836542.773383:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 219 00000100:00100000:3.0:1787836542.773404:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+61:11627:x1874682172239872:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836542.773428:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836542.773431:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787836542.773459:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab8304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1c8 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.773480:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836542.773486:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836542.773501:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8374 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1eb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787836542.773924:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787836542.774233:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab837b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.774248:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab837b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.774279:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab837b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.774339:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8374 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1eb expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.774357:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab837b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1eb expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.774365:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836542.774368:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836542.774371:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac400, rc 0) 00000100:00100000:3.0:1787836542.774452:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+62:11627:x1874682172239872:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1059us (1263us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787836542.774462:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 219 00000100:00100000:1.0:1787836542.787443:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.787527:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172240128 00000100:00100000:3.0:1787836542.787543:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172240128 00000100:00100000:3.0:1787836542.787642:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 220 00000100:00100000:3.0:1787836542.787654:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+62:11627:x1874682172240128:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787836542.787734:0:10086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836542.787781:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab837b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1eb expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.787808:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836542.787832:0:10086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836542.787867:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.787907:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.787919:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.787936:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.787943:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.787950:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788816:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788831:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788839:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788847:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.788852:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788862:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788879:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:3.0:1787836542.788895:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836542.788901:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788909:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab8389 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788928:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788934:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788941:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788947:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ace00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.788950:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788956:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788964:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x422f58b5 (ffff98e3d224a400) 00010000:00010000:3.0:1787836542.788966:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836542.788969:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.788975:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ace00/0x966835ea68ab8390 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x422f58b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836542.789270:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+61:11627:x1874682172240128:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 1614us (1841us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787836542.789286:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 220 00000100:00100000:1.0:1787836542.811187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.811300:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172240256 00000100:00100000:3.0:1787836542.811314:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172240256 00000100:00100000:3.0:1787836542.811392:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 221 00000100:00100000:3.0:1787836542.811415:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+61:11627:x1874682172240256:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836542.811446:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836542.811479:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab8397 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.811534:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.811553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.811569:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.811738:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab8397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.811763:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.811773:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836542.811777:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787836542.811781:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13acc00, rc 0) 00000100:00100000:3.0:1787836542.811864:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+62:11627:x1874682172240256:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 452us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.811881:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 221 00000100:00100000:1.0:1787836542.819114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.819760:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172240512 00000100:00100000:2.0:1787836542.819777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172240512 00000100:00100000:2.0:1787836542.819883:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 222 00000100:00100000:2.0:1787836542.819894:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+62:11627:x1874682172240512:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787836542.819993:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.820010:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.820021:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836542.820330:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787836542.820341:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391253282325ns, next at 392253279358ns, rc = 0 00000004:00010000:2.0:1787836542.820443:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008189cd6a reply state 0000000095d2e237 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836542.820454:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787836542.820563:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+64:11627:x1874682172240512:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 669us (1460us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787836542.820570:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 222 00010000:00010000:3.0:1787836542.823758:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.823778:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.823786:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.823793:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836542.823800:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.823808:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.823826:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836542.823830:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787836542.823836:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.823843:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.827304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.827410:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172240640 00000100:00100000:3.0:1787836542.827421:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172240640 00000100:00100000:3.0:1787836542.827490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 223 00000100:00100000:3.0:1787836542.827502:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+63:11627:x1874682172240640:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836542.827531:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836542.827579:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee1f9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.828503:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 64 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.828529:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 64 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.828559:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836542.828562:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836542.828567:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac400, rc 0) 00000100:00100000:3.0:1787836542.828716:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+64:11627:x1874682172240640:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1216us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.828725:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 223 00000100:00100000:1.0:1787836542.841387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836542.842195:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172240768 00000100:00100000:0.0:1787836542.842214:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172240768 00000100:00100000:0.0:1787836542.842315:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:0.0:1787836542.842329:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2364:x1874682172240768:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787836542.843155:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172240768:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 823us (1773us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787836542.843167:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:0.0:1787836542.849700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.849919:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172241024 00000100:00100000:2.0:1787836542.849930:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172241024 00000100:00100000:2.0:1787836542.849996:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:2.0:1787836542.850008:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+64:11627:x1874682172241024:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787836542.850325:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+65:11627:x1874682172241024:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 318us (703us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787836542.850333:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1787836542.859157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.859745:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172241280 00000100:00100000:2.0:1787836542.859986:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172241280 00000100:00100000:2.0:1787836542.860166:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 224 00000100:00100000:2.0:1787836542.860176:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+65:11627:x1874682172241280:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787836542.860388:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+65:11627:x1874682172241280:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 213us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.860404:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 224 00000100:00100000:1.0:1787836542.874228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.874946:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172241408 00000100:00100000:2.0:1787836542.874959:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172241408 00000100:00100000:2.0:1787836542.875044:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 225 00000100:00100000:2.0:1787836542.875193:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+65:11627:x1874682172241408:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836542.875217:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836542.875242:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab83b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee200 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.875354:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.875369:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.875383:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836542.876261:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836542.876285:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.876326:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab83b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee200 expref: 67 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.876371:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee200 expref: 66 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.876381:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:2.0:1787836542.876384:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787836542.876389:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836542.876485:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+66:11627:x1874682172241408:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1430us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.876494:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 225 00000100:00100000:0.0:1787836542.880637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.880898:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172241536 00000100:00100000:3.0:1787836542.880907:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172241536 00000100:00100000:3.0:1787836542.880968:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:3.0:1787836542.880977:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2361:x1874682172241536:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836542.880995:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836542.881017:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee207 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836542.881053:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90387d, blocks: 0x1 00010000:00010000:3.0:1787836542.881110:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1787836542.881115:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836542.881126:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.881163:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836542.881177:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ace00, rc 0) 00000100:00100000:3.0:1787836542.881245:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2361:x1874682172241536:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 270us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836542.881253:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:1.0:1787836542.890156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.890265:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172241792 00000100:00100000:2.0:1787836542.890278:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172241792 00000100:00100000:2.0:1787836542.890356:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 226 00000100:00100000:2.0:1787836542.890366:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8289680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+66:11627:x1874682172241792:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787836542.890508:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8289680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+66:11627:x1874682172241792:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 143us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.890516:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 226 00000100:00100000:0.0:1787836542.897349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.897598:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172241920 00000100:00100000:2.0:1787836542.897613:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172241920 00000100:00100000:2.0:1787836542.897762:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:2.0:1787836542.897777:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d1448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+9:11627:x1874682172241920:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787836542.897805:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836542.897832:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee20e expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.897883:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 10 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.897916:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836542.897921:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836542.897928:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 10 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.897979:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 10 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.897995:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 10 pid: 6691 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836542.898012:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27ebc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193199872:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836542.898203:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e567c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836542.909538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.910157:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27ebc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1874682193199872:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836542.910203:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 10 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836542.910230:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005bc00, rc 0) 00000100:00100000:2.0:1787836542.910315:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d1448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+10:11627:x1874682172241920:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 12541us (12978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836542.910327:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:1.0:1787836542.910553:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172242048 00000100:00100000:1.0:1787836542.910561:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172242048 00010000:00010000:1.0:1787836542.910608:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 10 pid: 6691 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.910672:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:1.0:1787836542.910682:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+10:2364:x1874682172242048:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836542.910698:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836542.910720:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 10 pid: 6691 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.910735:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 10 pid: 6691 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.910931:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001586b36b/0x966835ea68ab83c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee207 expref: 10 pid: 6691 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.910951:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836542.910955:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787836542.910963:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 9 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.910974:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 9 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836542.911011:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 9 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836542.911027:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c828b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1874682193200000:192.168.203.25@tcp:105: 00000100:00100000:1.0:1787836542.911432:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d114b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787836542.915762:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c828b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1874682193200000:192.168.203.25@tcp:105: 00010000:00010000:1.0:1787836542.915790:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836542.915853:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2364:x1874682172242048:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 5172us (6325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836542.915867:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:3.0:1787836542.921431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836542.921680:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172242176 00000100:00100000:2.0:1787836542.921690:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172242176 00002000:00100000:2.0:1787836542.921735:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff98e2c198c000 x1874682172242176/t0(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:328/0 lens 504/0 e 0 to 0 dl 1787836553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836542.921764:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e2c198c000 with x1874682172242176 ext(0->12) 00002000:00010000:2.0:1787836542.921769:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e2c198c000 00000100:00100000:2.0:1787836542.921795:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:2.0:1787836542.921804:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172242176:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787836542.922471:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+11:2363:x1874682172242176:12345-192.168.203.25@tcp:4:lhsmtool_posix.0 Request processed in 664us (1048us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787836542.922481:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00002000:00100000:2.0:1787836542.922489:0:6698:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff98e2c198c000 x1874682172242176/t4294967321(0) o4->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:328/0 lens 504/448 e 0 to 0 dl 1787836553 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836542.922497:0:6698:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e2c198c000 with x1874682172242176 ext(0->12) 00002000:00010000:2.0:1787836542.922501:0:6698:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e2c198c000 00000100:00100000:1.0:1787836542.925260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836542.925345:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172242304 00000100:00100000:3.0:1787836542.925356:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172242304 00000100:00100000:3.0:1787836542.925421:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 227 00000100:00100000:3.0:1787836542.925432:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+66:11627:x1874682172242304:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787836543.005114:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967491 is committed 00000020:00080000:0.0:1787836543.005160:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e3e9651180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787836543.005165:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e401e7de00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e3e9651d80 00000020:00080000:0.0:1787836543.005169:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e401e7dc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e3f5aea800 00000020:00080000:2.0:1787836543.005211:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000100:00100000:1.0:1787836543.005559:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+55:11627:x1874682172242304:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 80123us (80303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836543.005571:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 227 00000001:00080000:0.0:1787836543.005654:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000004:00080000:0.0:1787836543.005662:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787836543.005679:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e3e7d996c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787836543.005683:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3c4c00300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e3e7d993c0 00000020:00080000:0.0:1787836543.005685:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3c4c00d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e3f5f93800 00000001:00080000:0.0:1787836543.005704:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1787836543.005710:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:0.0:1787836543.005736:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787836543.008371:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787836543.008834:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787836543.009052:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787836543.009092:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193200128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787836543.009179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836543.009370:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193200128 00000100:00100000:2.0:1787836543.009379:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193200128 00000100:00100000:2.0:1787836543.009495:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787836543.009578:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193200128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787836543.009616:0:6691:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1787836543.009727:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a90387c, atime: 0x6a90387d, ctime: 0x6a90387c, blocks: 0x1 00010000:00010000:2.0:1787836543.009736:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.009770:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1787836543.009776:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836543.009785:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.009804:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.009814:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.009821:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.009841:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787836543.010907:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874682193200128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1396us (1721us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787836543.010921:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1787836543.010972:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836543.010981:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.010995:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836543.011000:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.011023:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.011053:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.011077:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007075e052/0x966835ea68ab83cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.011098:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836543.011100:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836543.011101:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787836543.011150:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e2c27ebc00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787836543.011157:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193200128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787836543.014326:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193200256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787836543.014404:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836543.014469:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836543.014476:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193200384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787836543.014501:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836543.014536:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193200256 00000100:00100000:2.0:1787836543.014543:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193200256 00000100:00100000:2.0:1787836543.014585:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193200384 00000100:00100000:2.0:1787836543.014588:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193200384 00000100:00100000:2.0:1787836543.014609:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787836543.014616:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193200256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787836543.014860:0:6692:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1787836543.014893:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.014919:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.014929:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787836543.014934:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836543.014938:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.014968:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.014981:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 10 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836543.014994:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874682193200512:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836543.015082:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3f5ed8180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836543.015110:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787836543.015118:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193200384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787836543.015301:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787836543.015305:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787836542 00002000:00010000:2.0:1787836543.015307:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787836543.015309:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787836541 -> 1787836542 00002000:00010000:2.0:1787836543.015319:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787836543.015367:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193200384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 250us (864us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787836543.015375:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1787836543.016566:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e2c27e83c0/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787836543.016582:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193200384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787836543.017467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836543.020188:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172242432 00000100:00100000:0.0:1787836543.020206:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172242432 00000100:00100000:0.0:1787836543.020316:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:0.0:1787836543.020327:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+11:2363:x1874682172242432:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1787836543.022335:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836543.036025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836543.036174:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172242560 00000100:00100000:0.0:1787836543.036185:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172242560 00010000:00010000:0.0:1787836543.036234:0:7631:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 12 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836543.036282:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:0.0:1787836543.036293:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8600450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+12:2363:x1874682172242560:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836543.036329:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836543.036335:0:7631:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 12 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.036349:0:7631:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 12 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.036376:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787836543.036382:0:7631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787836543.036387:0:7631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.036396:0:7631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.036419:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836543.036475:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8600450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+12:2363:x1874682172242560:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 185us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836543.036483:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 80 00010000:00010000:3.0:1787836543.036758:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b71feb/0x966835ea68ab8191 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee16d expref: 11 pid: 6693 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836543.036774:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874682193200512:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836543.036796:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.036808:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.036827:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.036837:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.036845:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.036873:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836543.037145:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836543.037152:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.037161:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836543.037165:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.037187:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.037201:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.037209:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab83d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.037227:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836543.037229:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836543.037231:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836543.037833:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193200256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23210us (23423us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787836543.037846:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1787836543.038307:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e2c27e8000/2, rc 0, transno 4294967323 00000100:00100000:1.0:1787836543.038318:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193200256:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787836543.075874:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1787836543.075902:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1787836543.075910:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1787836543.076193:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172242432:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 55860us (58728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836543.076208:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:1.0:1787836543.088642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836543.088766:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172242816 00000100:00100000:2.0:1787836543.088777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172242816 00000100:00100000:2.0:1787836543.088842:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 228 00000100:00100000:2.0:1787836543.088852:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11627:x1874682172242816:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787836543.088911:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836543.088938:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab83ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee200 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.088958:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:2.0:1787836543.088963:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787836543.088997:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.089030:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.089049:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836543.089346:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e646bbde reply state 0000000067f14c16 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836543.089370:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787836543.089490:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+21:11627:x1874682172242816:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 639us (859us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787836543.089498:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 228 00010000:00010000:3.0:1787836543.091044:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.091099:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.091107:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.091113:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836543.091118:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.091126:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.091161:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836543.091164:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836543.091170:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.091175:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b800/0x966835ea68ab83dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836543.092021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836543.092131:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172242944 00000100:00100000:2.0:1787836543.092140:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172242944 00000100:00100000:2.0:1787836543.092202:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:2.0:1787836543.092212:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2361:x1874682172242944:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787836543.092431:0:10087:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787836543.092435:0:10087:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787836542 -> 1787836541 00002000:00010000:2.0:1787836543.092437:0:10087:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787836541 00002000:00010000:2.0:1787836543.092439:0:10087:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787836542 -> 1787836541 00002000:00010000:2.0:1787836543.092441:0:10087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787836543.092501:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2361:x1874682172242944:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 290us (484us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787836543.092508:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:2.0:1787836543.102732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836543.105650:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172243200 00000100:00100000:3.0:1787836543.105670:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172243200 00000100:00100000:3.0:1787836543.105826:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 229 00000100:00100000:3.0:1787836543.105839:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+20:11627:x1874682172243200:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787836543.105932:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.105951:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.105962:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.106009:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.106025:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 20 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836543.106055:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193200640:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836543.106252:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0154780 going to sleep for 11 seconds 00000100:00100000:2.0:1787836543.108833:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fae82940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874682193200640:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836543.108863:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836543.111557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836543.111647:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172243328 00000100:00100000:3.0:1787836543.111660:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172243328 00010000:00010000:3.0:1787836543.111752:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 21 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836543.111799:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:3.0:1787836543.111810:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+21:2364:x1874682172243328:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836543.111829:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836543.111837:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 21 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.111852:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 21 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.111880:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab839e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f2 expref: 21 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.111898:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:3.0:1787836543.111903:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.111913:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.111922:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.111966:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836543.112040:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.112049:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836543.112100:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+20:2364:x1874682172243328:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 291us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836543.112108:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 81 00010000:00010000:0.0:1787836543.112114:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.112120:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.112127:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.112142:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836543.112147:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.112155:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.112166:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:0.0:1787836543.112168:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787836543.112172:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.112178:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad000/0x966835ea68ab83e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836543.112222:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+19:11627:x1874682172243200:12345-192.168.203.25@tcp:55:lhsmtool_posix.0 Request processed in 6387us (9501us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787836543.112231:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 229 00000100:00100000:3.0:1787836543.114352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836543.117792:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172243456 00000100:00100000:2.0:1787836543.117812:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172243456 00000100:00100000:2.0:1787836543.117892:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:2.0:1787836543.117904:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2363:x1874682172243456:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787836543.117978:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.118141:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 8 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.118153:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836543.118158:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787836543.118163:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.118204:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 8 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.118220:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 8 pid: 10087 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836543.118237:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27e8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874682193200768:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836543.118323:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3f5ed8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836543.123813:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27e8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1874682193200768:192.168.203.25@tcp:104: 00010000:00010000:2.0:1787836543.123850:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836543.124341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836543.124810:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172243584 00000100:00100000:1.0:1787836543.124821:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172243584 00010000:00010000:1.0:1787836543.124877:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 9 pid: 10087 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836543.124927:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:1.0:1787836543.124937:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb9443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+9:2363:x1874682172243584:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836543.124957:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836543.124987:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 9 pid: 10087 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.125024:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 9 pid: 10087 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.125154:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab83c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee20e expref: 9 pid: 10087 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.125174:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787836543.125178:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787836543.125183:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.125194:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.125219:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836543.125302:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb9443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2363:x1874682172243584:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 366us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836543.125311:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 82 00010000:00010000:2.0:1787836543.127297:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.127347:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.127395:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.127403:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.127413:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.127422:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836543.127426:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.127436:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.127459:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.127468:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab83eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836543.127600:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172243456:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 9695us (13258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836543.127610:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:3.0:1787836543.129915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836543.130113:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172243840 00000100:00100000:1.0:1787836543.130124:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172243840 00000100:00100000:1.0:1787836543.130208:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 230 00000100:00100000:1.0:1787836543.130219:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb946940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+19:11627:x1874682172243840:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787836543.130302:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.130323:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.130354:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.130581:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.130593:0:10086:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.130602:0:10086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.130638:0:10086:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.130652:0:10086:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 20 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836543.130665:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a8a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193200896:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836543.130762:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce009c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836543.137791:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a8a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193200896:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836543.137831:0:10086:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836543.141244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836543.142183:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172243968 00000100:00100000:1.0:1787836543.142196:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172243968 00010000:00010000:1.0:1787836543.142243:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 21 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836543.142283:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:1.0:1787836543.142292:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb947c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+21:2364:x1874682172243968:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836543.142330:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836543.142338:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 21 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.142352:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 21 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.142375:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab83ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1f9 expref: 21 pid: 5841 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.142394:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:1.0:1787836543.142400:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.142409:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.142417:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.142461:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836543.142519:0:10086:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.142529:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836543.142530:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb947c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2cd520e4-f240-41e5-b585-08ee5ec96478+20:2364:x1874682172243968:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 239us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836543.142538:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00000001:00080000:0.0:1787836543.142796:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787836543.142962:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787836543.143010:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787836543.143166:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d14483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10086:1874682193201024:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787836543.143238:0:10086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836543.143303:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3fabcd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836543.143428:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193201024 00000100:00100000:2.0:1787836543.143435:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193201024 00000100:00100000:2.0:1787836543.143485:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787836543.143496:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10086:x1874682193201024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787836543.143594:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10086:x1874682193201024:12345-0@lo:1000:mdt00_003.0 Request processed in 100us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836543.143601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787836543.143745:0:10086:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1787836543.143751:0:10086:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e2c27e83c0, transno 4294967322 00000100:00100000:0.0:1787836543.143772:0:10086:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98e2c27e8000 x1874682193200256/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787836559 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836543.143784:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d14483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10086:1874682193201024:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787836543.145162:0:10086:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787836543.145264:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3ee9ee940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10086:1874682193201152:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787836543.145341:0:10086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836543.145383:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3fabcd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787836543.146172:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193201152 00000100:00100000:2.0:1787836543.146184:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193201152 00000100:00100000:2.0:1787836543.146255:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787836543.146268:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10086:x1874682193201152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787836543.146564:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10086:x1874682193201152:12345-0@lo:1000:mdt00_003.0 Request processed in 299us (1222us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787836543.146580:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787836543.147380:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3ee9ee940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10086:1874682193201152:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787836543.147429:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147441:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147449:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147456:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836543.147461:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147469:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147487:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d224a000) 00010000:00010000:0.0:1787836543.147490:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787836543.147515:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147522:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4200/0x966835ea68ab83f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147559:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147566:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147573:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147578:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836543.147581:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147587:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147596:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:0.0:1787836543.147598:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787836543.147605:0:10086:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1dd expref: 23 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147615:0:10086:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1dd expref: 23 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147624:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1dd expref: 23 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.147676:0:10086:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1dd expref: 23 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836543.147690:0:10086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d14483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193201280:192.168.203.25@tcp:105: 00000100:00100000:0.0:1787836543.147815:0:10086:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3fabcd300 going to sleep for 11 seconds 00010000:00010000:2.0:1787836543.150662:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836543.156795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836543.157758:0:10086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d14483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10086:1874682193201280:192.168.203.25@tcp:105: 00010000:00010000:0.0:1787836543.157794:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157806:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a200/0x966835ea68ab833c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157852:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157868:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157882:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157894:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157900:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157906:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157933:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836543.157937:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157945:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157962:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:0.0:1787836543.157965:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836543.157970:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157975:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3f800/0x966835ea68ab8400 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157985:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157990:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.157997:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.158001:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836543.158004:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.158009:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.158028:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:0.0:1787836543.158040:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787836543.158045:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836543.158051:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab83f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836543.158389:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb946940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+23:11627:x1874682172243840:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 28170us (28486us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787836543.158402:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 230 00000020:00080000:0.0:1787836543.158410:0:10086:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787836543.158650:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836543.158655:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836543.159199:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787836543.159211:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787836543.163192:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172244096 00000100:00100000:2.0:1787836543.163212:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172244096 00000100:00100000:2.0:1787836543.163292:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:2.0:1787836543.163305:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+23:11626:x1874682172244096:12345-192.168.203.25@tcp:49:lfs.0 00000100:00100000:2.0:1787836543.163782:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+23:11626:x1874682172244096:12345-192.168.203.25@tcp:49:lfs.0 Request processed in 479us (6997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836543.163791:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:2.0:1787836543.187756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836543.188842:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172244352 00000100:00100000:1.0:1787836543.188859:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172244352 00000100:00100000:1.0:1787836543.188929:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:1.0:1787836543.188939:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93cb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+23:11627:x1874682172244352:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787836543.191275:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787836543.191419:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787836543.191512:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.191531:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.191544:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.191553:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.191559:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.191565:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.191744:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787836543.191917:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93cb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+25:11627:x1874682172244352:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 2972us (4165us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787836543.191929:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000020:00080000:2.0:1787836543.191936:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787836543.192119:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836543.192130:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.192139:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836543.192144:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.192154:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.192171:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98e3d8034800) 00010000:00010000:3.0:1787836543.192174:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787836543.192180:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.192187:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8407 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836543.192212:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836543.192227:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836543.192229:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836543.194962:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836543.200327:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172244608 00000100:00100000:3.0:1787836543.200349:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172244608 00000100:00100000:3.0:1787836543.200434:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 231 00000100:00100000:3.0:1787836543.200448:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+25:11626:x1874682172244608:12345-192.168.203.25@tcp:58:lfs.0 00000040:00080000:3.0:1787836543.200740:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787836543.200846:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+25:11626:x1874682172244608:12345-192.168.203.25@tcp:58:lfs.0 Request processed in 400us (5893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836543.200855:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 231 00000100:00100000:1.0:1787836543.251809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836543.251935:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172244736 00000100:00100000:2.0:1787836543.251947:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172244736 00000100:00100000:2.0:1787836543.252027:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 232 00000100:00100000:2.0:1787836543.252163:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+25:11630:x1874682172244736:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1787836543.252189:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836543.252225:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab840e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee215 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252294:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252307:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252319:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252334:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252342:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252348:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252679:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252691:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252700:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252733:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.252757:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 26 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836543.252772:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c27ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193201408:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836543.252889:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3f5ed86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836543.265204:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c27ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874682193201408:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836543.265235:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836543.270456:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836543.271898:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172244992 00000100:00100000:3.0:1787836543.271914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172244992 00000100:00100000:3.0:1787836543.271989:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:3.0:1787836543.272000:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+27:5599:x1874682172244992:12345-192.168.203.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787836543.272522:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+28:5599:x1874682172244992:12345-192.168.203.25@tcp:35:ldlm_bl.0 Request processed in 520us (2127us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787836543.272531:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 63 00000100:00100000:2.0:1787836543.280898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836543.281118:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172245120 00000100:00100000:1.0:1787836543.281133:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172245120 00010000:00010000:1.0:1787836543.281192:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 28 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836543.281229:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:1.0:1787836543.281241:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+28:2363:x1874682172245120:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836543.281262:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836543.281270:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 28 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.281286:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 28 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.281318:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005aa00/0x966835ea68ab832e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1d6 expref: 28 pid: 5842 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.281358:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836543.281363:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.281373:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.281382:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836543.283508:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836543.283627:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+27:2363:x1874682172245120:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 2377us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836543.283641:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 84 00010000:00010000:2.0:1787836543.285664:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285681:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787836543.285735:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787836543.285741:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787836543.285767:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285785:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285798:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285805:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285812:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285819:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005a800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836543.285844:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285853:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285871:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836543.285874:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836543.285880:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285887:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a800/0x966835ea68ab8415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285906:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285913:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285918:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285924:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836543.285926:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285932:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285940:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98e3d8034d00) 00010000:00010000:2.0:1787836543.285943:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836543.285955:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.285961:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005be00/0x966835ea68ab841c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.286010:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005a000/0x966835ea68ab840e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee215 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.286026:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee215 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836543.286046:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836543.286048:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836543.286050:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005bc00, rc 0) 00000100:00100000:2.0:1787836543.286878:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+26:11630:x1874682172244736:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 34711us (35073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836543.286891:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 232 00000100:00100000:2.0:1787836543.606376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836543.606512:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172245376 00000100:00100000:0.0:1787836543.606527:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172245376 00000100:00100000:0.0:1787836543.606639:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00100000:0.0:1787836543.606653:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2362:x1874682172245376:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836543.606777:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2362:x1874682172245376:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 128us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836543.606786:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00080000:1.0:1787836543.608298:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787836543.611935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836543.612006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836543.613831:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172245504 00000100:00100000:3.0:1787836543.613855:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172245504 00000100:00100000:3.0:1787836543.613961:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:3.0:1787836543.613973:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3eeaf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172245504:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836543.614146:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3eeaf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2361:x1874682172245504:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 176us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836543.614155:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 170 00000100:00100000:2.0:1787836543.614915:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172245248 00000100:00100000:2.0:1787836543.614923:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172245248 00000100:00100000:2.0:1787836543.614974:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 304 00000100:00100000:2.0:1787836543.614984:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172245248:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836543.615049:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172245248:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 68us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836543.615084:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 304 00000100:00080000:0.0:1787836543.615326:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787836544.174236:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836544.174248:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836544.174283:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787836544.174289:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787836544.174438:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c1327c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193201536:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787836544.174560:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eecb40 going to sleep for 11 seconds 00010000:00010000:1.0:1787836544.176794:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836544.198751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836544.200091:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172245632 00000100:00100000:3.0:1787836544.200108:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172245632 00000100:00100000:3.0:1787836544.200199:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 233 00000100:00100000:3.0:1787836544.200211:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee9ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+27:11641:x1874682172245632:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787836544.200244:0:10086:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787836544.200362:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee9ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+27:11641:x1874682172245632:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 154us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836544.200370:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 233 00000100:00080000:2.0:1787836544.202751:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836544.207814:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c1327c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1874682193201536:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787836544.210655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836544.210749:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172245888 00000100:00100000:3.0:1787836544.210760:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172245888 00000100:00100000:3.0:1787836544.210824:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 234 00000100:00100000:3.0:1787836544.210847:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+26:11641:x1874682172245888:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836544.210874:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836544.210901:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab842a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee21c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836544.211055:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836544.211111:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836544.211129:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836544.211147:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787836544.211314:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab842a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee21c expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836544.211339:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee21c expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836544.211349:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:3.0:1787836544.211352:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836544.211374:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13acc00, rc 0) 00000100:00100000:3.0:1787836544.211467:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1325e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+28:11641:x1874682172245888:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 623us (825us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787836544.211476:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 234 00000100:00100000:2.0:1787836544.234317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836544.234376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836544.236190:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172246144 00000100:00100000:2.0:1787836544.236212:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172246144 00000100:00100000:2.0:1787836544.236305:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 235 00000100:00100000:2.0:1787836544.236317:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+28:11641:x1874682172246144:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787836544.236449:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.236471:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.236498:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.236973:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.236983:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.236990:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.236998:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836544.237003:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.237009:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.237130:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836544.237141:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787836544.237147:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.237155:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab843f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836544.237192:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172246272 00000100:00100000:1.0:1787836544.237201:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172246272 00000100:00100000:2.0:1787836544.237330:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c198e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+30:11641:x1874682172246144:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 1012us (3026us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787836544.237341:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 235 00000100:00100000:1.0:1787836544.237422:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1787836544.237435:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+29:2364:x1874682172246272:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836544.237463:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836544.237483:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13acc00/0x966835ea68ab8431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee21c expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836544.237489:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787836544.237495:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:1.0:1787836544.237498:0:7631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:1.0:1787836544.237504:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836544.237530:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401d4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+28:2364:x1874682172246272:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 100us (3155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836544.237538:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000040:00080000:2.0:1787836544.240140:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787836544.240164:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787836544.254277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836544.254533:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172246528 00000100:00100000:0.0:1787836544.254545:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172246528 00000100:00100000:0.0:1787836544.254618:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 64 00000100:00100000:0.0:1787836544.254631:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+28:11641:x1874682172246528:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787836544.254992:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+29:11641:x1874682172246528:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 362us (725us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787836544.255002:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 64 00000040:00080000:0.0:1787836544.300658:0:12521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787836544.300672:0:12521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787836544.300726:0:12521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787836544.300733:0:12521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787836544.574511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836544.581186:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172246784 00000100:00100000:3.0:1787836544.581204:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172246784 00000100:00100000:3.0:1787836544.581287:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 236 00000100:00100000:3.0:1787836544.581297:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c615da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+29:11654:x1874682172246784:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836544.581323:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836544.581343:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab8446 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee223 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836544.581451:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab844d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836544.581465:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab844d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836544.581479:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab844d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836544.581491:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787836544.593278:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac400/0x966835ea68ab8446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee223 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.593311:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab844d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee223 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.593322:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836544.593325:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787836544.593329:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac800, rc 0) 00000100:00100000:2.0:1787836544.593435:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c615da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+31:11654:x1874682172246784:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 12138us (18939us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787836544.593446:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 236 00000100:00100000:1.0:1787836544.602670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836544.602750:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172246912 00000100:00100000:2.0:1787836544.602760:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172246912 00000100:00100000:2.0:1787836544.602846:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 237 00000100:00100000:2.0:1787836544.602856:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c1327c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+31:11654:x1874682172246912:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:2.0:1787836544.602938:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.602957:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.602970:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.602999:0:10086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.603005:0:10086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.603012:0:10086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.603019:0:10086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836544.603032:0:10086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.603039:0:10086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.603050:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836544.603053:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787836544.603099:0:10086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.603119:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005b200/0x966835ea68ab845b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836544.603189:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c1327c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+31:11654:x1874682172246912:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 335us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836544.603197:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 237 00000100:00100000:0.0:1787836544.680957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836544.681104:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172247040 00000100:00100000:2.0:1787836544.681114:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172247040 00000100:00100000:2.0:1787836544.681170:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:2.0:1787836544.681180:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172247040:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:2.0:1787836544.681203:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836544.681223:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab8462 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee22a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787836544.681252:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a90387d, atime: 0x6a90387d, ctime: 0x6a90387d, blocks: 0xb 00010000:00010000:2.0:1787836544.681274:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787836544.681279:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836544.681289:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab8462 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee22a expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.681308:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab8462 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee22a expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836544.681322:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b200, rc 0) 00000100:00100000:2.0:1787836544.681382:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2363:x1874682172247040:12345-192.168.203.25@tcp:101:cat.0 Request processed in 203us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836544.681399:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:1.0:1787836544.687385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836544.687506:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172247168 00000100:00100000:2.0:1787836544.687521:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172247168 00002000:00100000:2.0:1787836544.687586:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff98e3d14483c0 x1874682172247168/t0(0) o3->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:330/0 lens 488/0 e 0 to 0 dl 1787836555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836544.687598:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3d14483c0 with x1874682172247168 ext(0->4095) 00002000:00010000:2.0:1787836544.687605:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e3d14483c0 00000100:00100000:2.0:1787836544.687718:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1787836544.687729:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172247168:12345-192.168.203.25@tcp:3:cat.0 00000100:00100000:2.0:1787836544.688361:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d14483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+8:2364:x1874682172247168:12345-192.168.203.25@tcp:3:cat.0 Request processed in 628us (992us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787836544.688371:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00002000:00100000:2.0:1787836544.688380:0:6697:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff98e3d14483c0 x1874682172247168/t0(0) o3->2cd520e4-f240-41e5-b585-08ee5ec96478@192.168.203.25@tcp:330/0 lens 488/4536 e 0 to 0 dl 1787836555 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787836544.688390:0:6697:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff98e3d14483c0 with x1874682172247168 ext(0->4095) 00002000:00010000:2.0:1787836544.688394:0:6697:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98e3d14483c0 00010000:00010000:2.0:1787836545.199716:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836545.781769:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193201664:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.782755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836545.782883:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2875680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193202176:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.782936:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836545.782973:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787836545.782981:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193201792:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.783006:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836545.783045:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c28743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193202304:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.783089:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836545.783146:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193201920:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.783195:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836545.783231:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836545.783239:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2874b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193202048:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.783275:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836545.783340:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193202176 00000100:00100000:1.0:1787836545.783350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193202176 00000100:00100000:2.0:1787836545.786650:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193201792 00000100:00100000:2.0:1787836545.786678:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193201792 00000100:00100000:2.0:1787836545.786839:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193201920 00000100:00100000:2.0:1787836545.786844:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193201920 00000100:00100000:2.0:1787836545.786895:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787836545.786911:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2876940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193201792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836545.787098:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2876940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193201792:12345-0@lo:400:kworker.0 Request processed in 191us (4091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836545.787128:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787836545.787153:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787836545.787159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193201920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836545.787195:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2876d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193201920:12345-0@lo:400:kworker.0 Request processed in 36us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836545.787201:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1787836545.787343:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836545.789509:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193201792:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.789737:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193202304 00000100:00100000:1.0:1787836545.789747:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193202304 00000100:00100000:1.0:1787836545.789801:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193202048 00000100:00100000:1.0:1787836545.789805:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193202048 00000100:00100000:1.0:1787836545.789844:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787836545.789856:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c28752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1874682193202304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.789970:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c28752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1874682193202304:12345-0@lo:400:kworker.0 Request processed in 116us (6879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836545.789978:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787836545.789999:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787836545.790005:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2875e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193202048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.790097:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2875e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193202048:12345-0@lo:400:kworker.0 Request processed in 91us (6821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836545.790104:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787836545.790122:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836545.790127:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836545.790131:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836545.790160:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2874b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193202048:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.790175:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193201920:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.790211:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c28743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193202304:0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.790260:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787836545.790270:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c28761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193202176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836545.790309:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c28761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193202176:12345-0@lo:400:kworker.0 Request processed in 42us (7372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836545.790327:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787836545.790357:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2875680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193202176:0@lo:400:kworker.0 00000100:00100000:3.0:1787836545.791415:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193201664 00000100:00100000:3.0:1787836545.791430:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193201664 00000100:00100000:3.0:1787836545.791496:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787836545.791506:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193201664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836545.791606:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193201664:12345-0@lo:400:kworker.0 Request processed in 102us (8861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836545.791613:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787836545.791701:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193201664:0@lo:400:kworker.0 00010000:00010000:3.0:1787836546.222428:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836546.289940:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193202432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836546.290029:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836546.290165:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193202432 00000100:00100000:0.0:1787836546.290176:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193202432 00000100:00100000:0.0:1787836546.290247:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787836546.290258:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193202432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836546.290312:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836546.290364:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193202432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836546.290373:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787836546.290439:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193202432:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787836546.878478:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787836546.878503:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1787836547.246631:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836547.822309:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787836547.822341:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193202560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836547.822431:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836547.822572:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193202560 00000100:00100000:0.0:1787836547.822591:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193202560 00000100:00100000:0.0:1787836547.822665:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787836547.822674:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb945a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193202560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836547.822711:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836547.822758:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb945a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193202560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836547.822766:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1787836547.823143:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836547.823184:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193202560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787836548.273397:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787836548.440650:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1787836548.440677:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787836548.471978:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:0.0:1787836548.472033:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98e3fabcd480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787836548.472041:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3f5a67b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98e3fabcdb40 00000020:00080000:0.0:1787836548.472045:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98e3f5a67400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98e2c1d72c00 00000020:00080000:0.0:1787836548.472116:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787836548.472121:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000001:00080000:0.0:1787836548.472127:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787836548.472143:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787836548.472353:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1787836548.714159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836548.714200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836548.714235:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836548.714258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836548.714280:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836548.714314:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172247808 00000100:00100000:1.0:1787836548.714328:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172247808 00000100:00100000:1.0:1787836548.714404:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172247424 00000100:00100000:1.0:1787836548.714407:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172247424 00000100:00100000:1.0:1787836548.714433:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 174 00000100:00100000:1.0:1787836548.714444:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c28743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172247808:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836548.714540:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c28743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2362:x1874682172247808:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836548.714544:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172247552 00000100:00100000:3.0:1787836548.714548:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172247552 00000100:00100000:1.0:1787836548.714548:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 174 00000100:00100000:1.0:1787836548.714569:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 175 00000100:00100000:3.0:1787836548.714579:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172247680 00000100:00100000:3.0:1787836548.714581:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172247680 00000100:00100000:1.0:1787836548.714588:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2874b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2362:x1874682172247424:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836548.714603:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 104 00000100:00100000:3.0:1787836548.714609:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2875680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2362:x1874682172247552:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836548.714636:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2875680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2362:x1874682172247552:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836548.714643:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 104 00000100:00100000:3.0:1787836548.714655:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 105 00000100:00100000:3.0:1787836548.714661:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2875a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172247680:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836548.714682:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2875a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2362:x1874682172247680:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836548.714689:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 105 00000100:00100000:2.0:1787836548.714854:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172247296 00000100:00100000:2.0:1787836548.714858:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172247296 00000100:00100000:2.0:1787836548.714891:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 306 00000100:00100000:2.0:1787836548.714898:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172247296:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836548.714923:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2362:x1874682172247296:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836548.714930:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 306 00000100:00100000:1.0:1787836548.716635:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2874b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2362:x1874682172247424:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 42us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836548.716662:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 175 00000100:00080000:1.0:1787836548.716734:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836548.716749:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836548.716752:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787836549.298709:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836550.333591:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836550.831197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836550.832094:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172247936 00000100:00100000:2.0:1787836550.832110:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172247936 00000100:00100000:2.0:1787836550.832210:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 238 00000100:00100000:2.0:1787836550.832225:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c28770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11307:x1874682172247936:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1787836550.832429:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836550.832610:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c28770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11307:x1874682172247936:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 Request processed in 390us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836550.832619:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 238 00000100:00100000:1.0:1787836550.836987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836550.837489:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172248192 00000100:00100000:0.0:1787836550.837504:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172248192 00000100:00100000:0.0:1787836550.837596:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:0.0:1787836550.837609:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+18:11307:x1874682172248192:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787836550.838330:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2876580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+19:11307:x1874682172248192:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 721us (1366us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787836550.839645:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 65 00000100:00100000:2.0:1787836550.895037:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193202944:0@lo:400:kworker.0 00000100:00100000:2.0:1787836550.895124:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836550.895188:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836550.895194:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193203072:0@lo:400:kworker.0 00000100:00100000:2.0:1787836550.895228:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836550.895263:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193202944 00000100:00100000:2.0:1787836550.895270:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193202944 00000100:00100000:2.0:1787836550.895324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787836550.895332:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193202944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836550.895381:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193202944:12345-0@lo:400:kworker.0 Request processed in 50us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836550.895388:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787836550.895412:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193203072 00000100:00100000:2.0:1787836550.895415:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193203072 00000100:00100000:2.0:1787836550.895456:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787836550.895463:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193203072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836550.895494:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193203072:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836550.895499:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787836550.895518:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787836550.895523:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836550.895546:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1787836550.895552:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e2c27e8000, transno 4294967323 00000004:00080000:2.0:1787836550.895562:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1787836550.895582:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193203072:0@lo:400:kworker.0 00000100:00100000:2.0:1787836550.895594:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193202944:0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896108:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c22df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193202816:0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836550.896172:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193203328:0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896194:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836550.896215:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787836550.896222:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193202688:0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896249:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836550.896273:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5f9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193203200:0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896294:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836550.896319:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193203328 00000100:00100000:1.0:1787836550.896325:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193203328 00000100:00100000:1.0:1787836550.896364:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787836550.896371:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2877840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193203328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896409:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2877840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193203328:12345-0@lo:400:kworker.0 Request processed in 38us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836550.896415:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787836550.896452:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193202688 00000100:00100000:1.0:1787836550.896456:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193202688 00000100:00100000:1.0:1787836550.896481:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787836550.896487:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193202688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896517:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193202688:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836550.896532:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:1.0:1787836550.896568:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836550.896588:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193202688:0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896599:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787836550.896605:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787836550.896620:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e2c27ebc00, transno 4294967310 00000100:00100000:1.0:1787836550.896632:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193203328:0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.896904:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193202816 00000100:00100000:1.0:1787836550.896909:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193202816 00000100:00100000:1.0:1787836550.896933:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193203200 00000100:00100000:1.0:1787836550.896937:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193203200 00000100:00100000:1.0:1787836550.896960:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787836550.896965:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193202816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.897015:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2877c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193202816:12345-0@lo:400:kworker.0 Request processed in 49us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836550.897021:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787836550.897034:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787836550.897040:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193203200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.897095:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874682193203200:12345-0@lo:400:kworker.0 Request processed in 56us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836550.897101:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1787836550.897115:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836550.897134:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5f9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874682193203200:0@lo:400:kworker.0 00000100:00100000:1.0:1787836550.897144:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c22df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193202816:0@lo:400:kworker.0 00000100:00100000:0.0:1787836551.176711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836551.176867:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172248320 00000100:00100000:1.0:1787836551.176895:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172248320 00000100:00100000:1.0:1787836551.176996:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 239 00000100:00100000:1.0:1787836551.177007:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:12105:x1874682172248320:12345-192.168.203.25@tcp:101:lsof.0 00010000:00010000:1.0:1787836551.177030:0:10086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836551.177055:0:10086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee231 expref: -99 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836551.177160:0:10086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8470 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836551.177174:0:10086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836551.177187:0:10086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787836551.177458:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787836551.177587:0:10086:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787836551.177592:0:10086:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836551.177675:0:10086:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836551.177705:0:10086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee231 expref: 7 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836551.177721:0:10086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee231 expref: 6 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836551.177729:0:10086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:1.0:1787836551.177732:0:10086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836551.177735:0:10086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5c00, rc 0) 00000100:00100000:1.0:1787836551.177890:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:12105:x1874682172248320:12345-192.168.203.25@tcp:101:lsof.0 Request processed in 884us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836551.177898:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 239 00010000:00010000:0.0:1787836551.343952:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836551.406595:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787836551.408862:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193203456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787836551.408987:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836551.417830:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193203456 00000100:00100000:0.0:1787836551.417852:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193203456 00000100:00100000:0.0:1787836551.417936:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787836551.417948:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb947840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193203456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836551.418010:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836551.418837:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193203456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836551.418913:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb947840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193203456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 966us (9924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836551.418922:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:3.0:1787836552.369626:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836552.942457:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193203584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836552.942555:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836552.942706:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193203584 00000100:00100000:2.0:1787836552.942716:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193203584 00000100:00100000:2.0:1787836552.942794:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787836552.942804:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb944780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193203584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836552.942869:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787836552.942959:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836552.943184:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb944780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193203584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 381us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836552.943194:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787836552.943274:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193203584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787836553.392034:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787836553.479691:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787836553.479710:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787836553.479753:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787836553.479763:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1787836553.834139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836553.834368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836553.834410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836553.834449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836553.834476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836553.834523:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172248704 00000100:00100000:1.0:1787836553.834533:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172248704 00000100:00100000:1.0:1787836553.834594:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172248832 00000100:00100000:1.0:1787836553.834597:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172248832 00000100:00100000:1.0:1787836553.834622:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00100000:1.0:1787836553.834633:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2361:x1874682172248704:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836553.834710:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2361:x1874682172248704:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 79us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836553.834718:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 108 00000100:00100000:1.0:1787836553.834740:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 109 00000100:00100000:1.0:1787836553.834746:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c22df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172248832:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836553.834771:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c22df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2361:x1874682172248832:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836553.834776:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 109 00000100:00080000:1.0:1787836553.834790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836553.834806:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836553.835022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172248960 00000100:00100000:2.0:1787836553.835027:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172248960 00000100:00100000:3.0:1787836553.835092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172248448 00000100:00100000:3.0:1787836553.835098:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172248448 00000100:00100000:2.0:1787836553.835106:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172248576 00000100:00100000:2.0:1787836553.835110:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172248576 00000100:00100000:2.0:1787836553.835139:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 179 00000100:00100000:2.0:1787836553.835147:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2361:x1874682172248960:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836553.835151:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 308 00000100:00100000:3.0:1787836553.835171:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172248448:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836553.835188:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2874780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2361:x1874682172248960:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 41us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836553.835196:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 179 00000100:00100000:3.0:1787836553.835207:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2361:x1874682172248448:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 46us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836553.835214:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 180 00000100:00100000:3.0:1787836553.835218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 308 00000100:00100000:2.0:1787836553.835227:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2361:x1874682172248576:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836553.835260:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2874f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2361:x1874682172248576:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 35us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836553.835267:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 180 00000100:00080000:1.0:1787836553.840429:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787836554.418464:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787836554.479272:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787836554.479285:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787836554.484351:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1787836554.484369:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1787836555.170749:0:12722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:15:52 (1787836552) 00010000:00010000:2.0:1787836555.443276:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836556.015761:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193203712:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.015837:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836556.015884:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193204224:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.015911:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836556.015938:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787836556.015960:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5fc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193203840:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.015984:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836556.016002:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193204352:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016022:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836556.016049:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193203968:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836556.016115:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836556.016120:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193204096:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016140:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836556.016170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193203712 00000100:00100000:1.0:1787836556.016176:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193203712 00000100:00100000:1.0:1787836556.016219:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787836556.016227:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193203712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016347:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193203712:12345-0@lo:400:kworker.0 Request processed in 119us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836556.016354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787836556.016464:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193204224 00000100:00100000:1.0:1787836556.016468:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193204224 00000100:00100000:1.0:1787836556.016517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193203840 00000100:00100000:1.0:1787836556.016521:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193203840 00000100:00100000:1.0:1787836556.016546:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193203968 00000100:00100000:1.0:1787836556.016549:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193203968 00000100:00100000:1.0:1787836556.016563:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787836556.016569:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193204224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016604:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193204224:12345-0@lo:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836556.016610:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787836556.016623:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787836556.016629:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193203840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016654:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193203840:12345-0@lo:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836556.016660:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787836556.016671:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787836556.016678:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193203968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016709:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193203968:12345-0@lo:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836556.016715:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787836556.016737:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193204352 00000100:00100000:1.0:1787836556.016740:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193204352 00000100:00100000:1.0:1787836556.016765:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193204096 00000100:00100000:1.0:1787836556.016767:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193204096 00000100:00100000:1.0:1787836556.016788:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787836556.016794:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193204352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016827:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193204352:12345-0@lo:400:kworker.0 Request processed in 33us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836556.016833:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787836556.016844:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787836556.016855:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193204096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016887:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193204096:12345-0@lo:400:kworker.0 Request processed in 32us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836556.016893:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787836556.016923:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836556.016928:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836556.016930:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836556.016982:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193204096:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.016995:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401d01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193203968:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.017038:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5fc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193203840:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.017048:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193204352:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.017056:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193203712:0@lo:400:kworker.0 00000100:00100000:1.0:1787836556.017091:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193204224:0@lo:400:kworker.0 00010000:00010000:1.0:1787836556.465670:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836556.528684:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787836556.528707:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193204480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836556.528776:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836556.528835:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193204480 00000100:00100000:0.0:1787836556.528855:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193204480 00000100:00100000:0.0:1787836556.528905:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787836556.528915:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193204480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836556.528959:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836556.529004:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193204480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836556.529011:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787836556.529073:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193204480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787836557.486458:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836558.062588:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193204608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836558.062666:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836558.062871:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193204608 00000100:00100000:0.0:1787836558.062880:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193204608 00000100:00100000:0.0:1787836558.062967:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787836558.062978:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193204608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836558.063013:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836558.063122:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193204608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836558.063130:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787836558.063315:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193204608:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787836558.063484:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787836558.510247:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836558.953565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836558.953606:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836558.953647:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836558.953681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836558.953719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836558.953887:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172249600 00000100:00100000:0.0:1787836558.953905:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172249600 00000100:00100000:0.0:1787836558.953976:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172249216 00000100:00100000:0.0:1787836558.953980:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172249216 00000100:00100000:0.0:1787836558.954013:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 184 00000100:00100000:0.0:1787836558.954023:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2363:x1874682172249600:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836558.954125:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2363:x1874682172249600:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 103us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836558.954132:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 184 00000100:00100000:0.0:1787836558.954152:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 185 00000100:00100000:0.0:1787836558.954159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2363:x1874682172249216:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836558.954185:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:2363:x1874682172249216:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836558.954191:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 185 00000100:00100000:3.0:1787836558.955226:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172249088 00000100:00100000:3.0:1787836558.955233:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172249088 00000100:00100000:3.0:1787836558.955290:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 310 00000100:00100000:3.0:1787836558.955299:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2363:x1874682172249088:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836558.955340:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2363:x1874682172249088:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 42us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836558.955346:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 310 00000100:00080000:2.0:1787836558.955742:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836558.955810:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172249344 00000100:00100000:1.0:1787836558.955816:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172249344 00000100:00100000:1.0:1787836558.955862:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172249472 00000100:00100000:1.0:1787836558.955866:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172249472 00000100:00100000:1.0:1787836558.955890:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 112 00000100:00100000:1.0:1787836558.955908:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172249344:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836558.955948:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2363:x1874682172249344:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 51us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836558.955954:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 112 00000100:00100000:1.0:1787836558.955984:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00100000:1.0:1787836558.955990:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172249472:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836558.956016:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2363:x1874682172249472:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836558.956022:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 113 00000100:00080000:2.0:1787836558.958216:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787836558.958224:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787836559.534570:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836559.886133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836559.886984:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172249856 00000100:00100000:1.0:1787836559.886996:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172249856 00000100:00100000:1.0:1787836559.887079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:1.0:1787836559.887090:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+18:12327:x1874682172249856:12345-192.168.203.25@tcp:35:umount.0 00000100:00100000:1.0:1787836559.887792:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:12327:x1874682172249856:12345-192.168.203.25@tcp:35:umount.0 Request processed in 703us (1668us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787836559.887802:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 66 00000100:00100000:0.0:1787836559.903498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836559.903910:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172250112 00000100:00100000:1.0:1787836559.903931:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172250112 00000100:00100000:1.0:1787836559.903991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:1.0:1787836559.904001:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+19:12327:x1874682172250112:12345-192.168.203.25@tcp:35:umount.0 00000100:00100000:1.0:1787836559.904405:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+20:12327:x1874682172250112:12345-192.168.203.25@tcp:35:umount.0 Request processed in 404us (916us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787836559.904413:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 67 00000100:00100000:0.0:1787836559.925301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836559.925700:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172250368 00000100:00100000:1.0:1787836559.925710:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172250368 00000100:00100000:1.0:1787836559.925778:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:1.0:1787836559.925789:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e93c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+20:12327:x1874682172250368:12345-192.168.203.25@tcp:35:umount.0 00000100:00100000:1.0:1787836559.926336:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e93c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+21:12327:x1874682172250368:12345-192.168.203.25@tcp:35:umount.0 Request processed in 546us (1047us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787836559.926352:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 68 00000100:00100000:3.0:1787836559.931054:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836559.931442:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172250624 00000100:00100000:2.0:1787836559.931452:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172250624 00000100:00100000:2.0:1787836559.931508:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:2.0:1787836559.931517:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+21:12327:x1874682172250624:12345-192.168.203.25@tcp:35:umount.0 00000100:00100000:2.0:1787836559.931844:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+22:12327:x1874682172250624:12345-192.168.203.25@tcp:35:umount.0 Request processed in 327us (799us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787836559.931863:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 69 00000100:00100000:0.0:1787836559.937134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836559.937182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836559.937215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836559.937312:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172250752 00000100:00100000:2.0:1787836559.937322:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172250752 00000100:00100000:2.0:1787836559.937382:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172251008 00000100:00100000:2.0:1787836559.937395:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172251008 00000100:00100000:2.0:1787836559.937417:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172250880 00000100:00100000:2.0:1787836559.937420:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172250880 00000100:00100000:2.0:1787836559.937437:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:2.0:1787836559.937446:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+15:2364:x1874682172250752:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836559.937477:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836559.937496:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab74e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddbc expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.937514:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836559.937562:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+14:2364:x1874682172250752:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 117us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836559.937570:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:2.0:1787836559.937590:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836559.937596:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+13:2364:x1874682172251008:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836559.937605:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836559.937614:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031a00/0x966835ea68ab76fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede87 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.937623:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836559.937641:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:2364:x1874682172251008:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 45us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836559.937647:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836559.937687:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:2.0:1787836559.937694:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:2364:x1874682172250880:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836559.937702:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836559.937711:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ada00/0x966835ea68ab744e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edd84 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.937720:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836559.937737:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2364:x1874682172250880:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 43us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836559.937750:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1787836559.938672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836559.941129:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172251136 00000100:00100000:2.0:1787836559.941143:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172251136 00000100:00100000:2.0:1787836559.941222:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:2.0:1787836559.941232:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2360:x1874682172251136:12345-192.168.203.25@tcp:9:umount.0 00000020:00000080:2.0:1787836559.941276:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab77c0 00000100:00080000:2.0:1787836559.941288:0:6691:0:(import.c:65:import_set_state_nolock()) ffff98e401d41800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787836559.941335:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1787836559.941536:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836559.941629:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+2:2360:x1874682172251136:12345-192.168.203.25@tcp:9:umount.0 Request processed in 398us (2963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836559.941638:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:2.0:1787836559.950659:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836559.950763:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172251520 00000100:00100000:1.0:1787836559.950772:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172251520 00000100:00100000:1.0:1787836559.950833:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:1.0:1787836559.950843:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+7:2360:x1874682172251520:12345-192.168.203.25@tcp:9:umount.0 00000020:00000080:1.0:1787836559.950877:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7a28 00000020:00010000:1.0:1787836559.950885:0:6692:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e3c404d800: total 0 00000100:00080000:1.0:1787836559.950890:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98e3c4049800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787836559.950943:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787836559.951269:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2cd520e4-f240-41e5-b585-08ee5ec96478+5:2360:x1874682172251520:12345-192.168.203.25@tcp:9:umount.0 Request processed in 426us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836559.951289:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 74 00000020:00010000:2.0:1787836559.951358:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e3c404d800: total 0 00010000:00010000:2.0:1787836559.951398:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e3c404d800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787836559.951473:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029fd4bc3/0x966835ea68ab8462 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee22a expref: 4 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.951505:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb13803f/0x966835ea68ab7dc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee05c expref: 3 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.951520:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e3c404d800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787836559.951531:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836559.951533:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836559.951534:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836559.974171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836559.974373:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172252544 00000100:00100000:0.0:1787836559.974383:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172252544 00000100:00100000:0.0:1787836559.974444:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 240 00000100:00100000:0.0:1787836559.974454:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+22:2360:x1874682172252544:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:0.0:1787836559.974514:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab745c 00000020:00010000:0.0:1787836559.974529:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e2c2db2000: total 0 00000100:00080000:0.0:1787836559.974534:0:5841:0:(import.c:65:import_set_state_nolock()) ffff98e2c2db7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787836559.974567:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787836559.974940:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2cd520e4-f240-41e5-b585-08ee5ec96478+21:2360:x1874682172252544:12345-192.168.203.25@tcp:39:umount.0 Request processed in 486us (776us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787836559.974948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 240 00000020:00010000:2.0:1787836559.975154:0:7633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e2c2db2000: total 0 00010000:00010000:2.0:1787836559.975195:0:7633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e2c2db2000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787836559.975238:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836559.975243:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787836559.975252:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a000/0x966835ea68ab8121 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee151 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975272:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836559.975275:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787836559.975279:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4800/0x966835ea68ab7796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edeb1 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975292:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836559.975295:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787836559.975299:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee1dd expref: 18 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975312:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98e3d1431f00) 00010000:00010000:2.0:1787836559.975314:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787836559.975318:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fa00/0x966835ea68ab7a83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000edf83 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975335:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98e3d224a100) 00010000:00010000:2.0:1787836559.975337:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787836559.975341:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad200/0x966835ea68ab7e42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee07f expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975357:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836559.975360:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787836559.975364:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13aca00/0x966835ea68ab7ca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee00f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975392:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:2.0:1787836559.975395:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836559.975399:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3fc00/0x966835ea68ab7e26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee078 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975410:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3d1431200) 00010000:00010000:2.0:1787836559.975412:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836559.975428:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5600/0x966835ea68ab7742 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede9c expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975444:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836559.975447:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836559.975451:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005ae00/0x966835ea68ab7d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee047 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975474:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836559.975477:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787836559.975481:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3d005bc00/0x966835ea68ab8423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee215 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975493:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98e3d1431d00) 00010000:00010000:2.0:1787836559.975496:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787836559.975499:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ac800/0x966835ea68ab844d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee223 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975513:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e3d81a4300) 00010000:00010000:2.0:1787836559.975515:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787836559.975525:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e401d3ea00/0x966835ea68ab7726 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede95 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975543:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98e3d8034e00) 00010000:00010000:2.0:1787836559.975545:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787836559.975548:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e2c13ad800/0x966835ea68ab7daf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee055 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836559.975561:0:7633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e2c2db2000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787836559.975573:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836559.975575:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836559.975577:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836560.558332:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836561.136479:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193204992:0@lo:400:kworker.0 00000100:00100000:1.0:1787836561.136575:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836561.136657:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836561.136663:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193205120:0@lo:400:kworker.0 00000100:00100000:1.0:1787836561.136692:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836561.136729:0:10086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193204992 00000100:00100000:1.0:1787836561.136748:0:10086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193204992 00000100:00100000:1.0:1787836561.136830:0:10086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787836561.136841:0:10086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193204992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836561.136897:0:10086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193204992:12345-0@lo:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836561.136928:0:10086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787836561.136957:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193205120 00000100:00100000:1.0:1787836561.136961:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193205120 00000100:00100000:1.0:1787836561.136987:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787836561.136993:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c26492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193205120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836561.137025:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c26492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193205120:12345-0@lo:400:kworker.0 Request processed in 33us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836561.137030:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787836561.137092:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193205120:0@lo:400:kworker.0 00000100:00100000:1.0:1787836561.137103:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193204992:0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.137417:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193204736:0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.137454:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836561.137506:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c26483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193205248:0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.137533:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836561.137552:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787836561.137558:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193204864:0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.137579:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836561.137598:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193205376:0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.137618:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836561.137646:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193205248 00000100:00100000:3.0:1787836561.137650:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193205248 00000100:00100000:3.0:1787836561.137683:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193204864 00000100:00100000:3.0:1787836561.137686:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193204864 00000100:00100000:3.0:1787836561.137701:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787836561.137708:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193205248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.137757:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874682193205248:12345-0@lo:400:kworker.0 Request processed in 49us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836561.137764:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787836561.137778:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787836561.137784:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193204864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.137821:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193204864:12345-0@lo:400:kworker.0 Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836561.137827:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787836561.137857:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193204864:0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.137866:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c26483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193205248:0@lo:400:kworker.0 00000100:00100000:1.0:1787836561.138008:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193204736 00000100:00100000:1.0:1787836561.138012:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193204736 00000100:00100000:1.0:1787836561.138049:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787836561.138080:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193204736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836561.138095:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193205376 00000100:00100000:0.0:1787836561.138099:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193205376 00000100:00100000:1.0:1787836561.138118:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3312:x1874682193204736:12345-0@lo:400:kworker.0 Request processed in 63us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836561.138125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787836561.138129:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787836561.138135:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c27e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193205376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836561.138171:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c27e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193205376:12345-0@lo:400:kworker.0 Request processed in 35us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836561.138177:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1787836561.138429:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787836561.138435:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787836561.138438:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836561.138658:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193205376:0@lo:400:kworker.0 00000100:00100000:3.0:1787836561.138671:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e8e7a0a-4610-42c5-99e6-210da529f97c:3312:1874682193204736:0@lo:400:kworker.0 00000100:00100000:0.0:1787836561.363236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836561.363279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836561.363320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836561.363524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836561.363568:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172253184 00000100:00100000:0.0:1787836561.363578:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172253184 00000100:00100000:0.0:1787836561.363632:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 241 00000100:00100000:0.0:1787836561.363642:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+6:2360:x1874682172253184:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:0.0:1787836561.363679:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7543 00000020:00010000:0.0:1787836561.363687:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e3ee576000: total 0 00000100:00080000:0.0:1787836561.363692:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98e401e6c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787836561.363713:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787836561.364452:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a64a6682-9f1f-4978-b16c-a7d486c0bf01+5:2360:x1874682172253184:12345-192.168.203.25@tcp:39:umount.0 Request processed in 803us (920us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787836561.364482:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 241 00000100:00080000:0.0:1787836561.365814:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1787836561.365831:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e3ee576000: total 0 00010000:00010000:0.0:1787836561.365837:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836561.365896:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e3ee576000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787836561.365949:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d81a4f00) 00010000:00010000:0.0:1787836561.365953:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836561.365966:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8470 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee231 expref: 4 pid: 10086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836561.365992:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e3ee576000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787836561.366004:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836561.366007:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836561.366008:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836561.368121:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172252672 00000100:00100000:2.0:1787836561.368136:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172252672 00000100:00100000:2.0:1787836561.368234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172252928 00000100:00100000:2.0:1787836561.368238:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172252928 00000100:00100000:2.0:1787836561.368261:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172252800 00000100:00100000:2.0:1787836561.368265:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172252800 00000100:00100000:2.0:1787836561.368286:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1787836561.368296:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+12:2363:x1874682172252672:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836561.368325:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836561.368350:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031800/0x966835ea68ab752e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddd1 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836561.368368:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836561.368433:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+11:2363:x1874682172252672:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 138us (5209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836561.368470:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1787836561.368492:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1787836561.368498:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+10:2363:x1874682172252928:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836561.369087:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836561.369193:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ac000/0x966835ea68ab76f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ede80 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836561.369268:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836561.369366:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+9:2363:x1874682172252928:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 866us (6085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836561.369375:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1787836561.369401:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:2.0:1787836561.369409:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+8:2363:x1874682172252800:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836561.369420:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836561.369430:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ade00/0x966835ea68ab7535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddfb expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836561.369440:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836561.369469:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+7:2363:x1874682172252800:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 61us (6148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836561.369475:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:0.0:1787836561.393595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836561.393709:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172253440 00000100:00100000:1.0:1787836561.393719:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172253440 00000100:00100000:1.0:1787836561.393788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 312 00000100:00100000:1.0:1787836561.393798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+7:2360:x1874682172253440:12345-192.168.203.25@tcp:251:umount.0 00000020:00000080:1.0:1787836561.393988:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7439 00000020:00010000:1.0:1787836561.393997:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e3ee572800: total 0 00000100:00080000:1.0:1787836561.394002:0:5833:0:(import.c:65:import_set_state_nolock()) ffff98e3ee577000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787836561.394215:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca08bc65-fcc3-4057-9765-e4ee8e6d6c49+3:2360:x1874682172253440:12345-192.168.203.25@tcp:251:umount.0 Request processed in 417us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836561.394238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 312 00000020:00010000:2.0:1787836561.394363:0:7633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e3ee572800: total 0 00010000:00010000:2.0:1787836561.394412:0:7633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e3ee572800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787836561.394449:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031e00/0x966835ea68ab74ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000eddc3 expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836561.394473:0:7633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e3ee572800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787836561.394482:0:7633:0:(genops.c:885:class_export_put()) final put ffff98e3ee572800/ca08bc65-fcc3-4057-9765-e4ee8e6d6c49 00010000:00010000:2.0:1787836561.394569:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836561.394572:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836561.394574:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787836561.394610:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ee572800/ca08bc65-fcc3-4057-9765-e4ee8e6d6c49 for MGS 00000020:00000080:1.0:1787836561.394655:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3ee577000 for MGS 00010000:00010000:1.0:1787836561.582421:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836561.648052:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193205504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836561.648240:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836561.648696:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193205504 00000100:00100000:1.0:1787836561.648705:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193205504 00000100:00100000:1.0:1787836561.648772:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787836561.648781:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193205504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787836561.648824:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836561.649036:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193205504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836561.649046:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787836561.649452:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193205504:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787836562.285051:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:1.0:1787836562.285085:0:7644:0:(genops.c:885:class_export_put()) final put ffff98e401d43800/2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:0.0:1787836562.286233:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e401d43800/2cd520e4-f240-41e5-b585-08ee5ec96478 for lustre-OST0001 00000020:00000080:0.0:1787836562.286309:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e401d41800 for lustre-OST0001 00010000:00010000:3.0:1787836562.606396:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836563.184681:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193205632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836563.184763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836563.184968:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193205632 00000100:00100000:0.0:1787836563.184977:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193205632 00000100:00100000:0.0:1787836563.185107:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787836563.185115:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787836563.185126:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787836563.185129:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193205632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836563.185170:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836563.185273:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193205632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836563.185302:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787836563.185591:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836563.185649:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193205632:0@lo:13:osp-pre-0-0.0 00000020:01000004:3.0:1787836563.549175:0:12920:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787836563.566431:0:12920:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787836563.566493:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.566512:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.566520:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.566528:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.566552:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787836563.566558:0:12920:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787836563.566585:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787836563.566590:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787836563.566597:0:12920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787836563.566629:0:12920:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787836563.566668:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193205760:0@lo:39:umount.0 00000100:00100000:3.0:1787836563.566763:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836563.566803:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193205760 00000100:00100000:0.0:1787836563.566813:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193205760 00000100:00100000:1.0:1787836563.566908:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787836563.566921:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874682193205760:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787836563.566956:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7248 00000100:00080000:1.0:1787836563.566966:0:5842:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7ff800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787836563.567054:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1874682193205760:12345-0@lo:39:umount.0 Request processed in 136us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836563.567096:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787836563.567109:0:5842:0:(genops.c:885:class_export_put()) final put ffff98e3ef7fd000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787836563.567141:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ef7fd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787836563.567213:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3ef7ff800 for lustre-MDT0000 00000100:00080000:1.0:1787836563.567255:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787836563.567264:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193205760:0@lo:39:umount.0 00010000:00010000:2.0:1787836563.568449:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836563.568462:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836563.568475:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005ac00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:2.0:1787836563.568480:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836563.568491:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787836563.568498:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836563.568504:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787836563.568507:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787836563.568510:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787836563.568549:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836563.568556:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787836563.568595:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836563.568603:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005ac00/0x966835ea68ab74be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74c5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836563.568617:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836563.568618:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836563.568620:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836563.568652:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787836563.568669:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193205888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836563.568730:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836563.568799:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193205888 00000100:00100000:2.0:1787836563.568805:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193205888 00000100:00100000:2.0:1787836563.568844:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787836563.568853:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193205888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787836563.568865:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836563.568882:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0030e00/0x966835ea68ab74c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab74be expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.568953:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787836563.568967:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787836563.568972:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787836563.568977:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787836563.569861:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.569901:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.569908:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.569914:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.569934:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836563.569947:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836563.569951:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.569958:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:3.0:1787836563.569961:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.569969:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787836563.569975:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836563.569981:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787836563.569983:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787836563.570005:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570020:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787836563.570037:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570044:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab74cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570077:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836563.570079:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836563.570081:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836563.570091:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570099:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570105:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570111:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570124:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836563.570129:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570136:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570152:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570159:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570171:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787836563.570178:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787836563.570183:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570189:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152ac00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:3.0:1787836563.570192:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570199:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787836563.570205:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836563.570211:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787836563.570213:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787836563.570215:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787836563.570231:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570237:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787836563.570248:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570261:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c152ac00/0x966835ea68ab73f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab73fa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570275:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836563.570278:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570284:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:3.0:1787836563.570287:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570294:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787836563.570300:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836563.570305:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787836563.570307:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787836563.570309:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787836563.570337:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570344:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787836563.570350:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570356:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab76e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab76ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570374:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836563.570375:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836563.570377:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836563.570387:0:12920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570395:0:12920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570401:0:12920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570407:0:12920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570418:0:12920:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787836563.570421:0:12920:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787836563.570424:0:12920:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787836563.570445:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836563.570449:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570455:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:3.0:1787836563.570458:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570465:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787836563.570482:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836563.570487:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787836563.570489:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787836563.570491:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787836563.570504:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570510:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787836563.570516:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570522:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0030600/0x966835ea68ab71a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab71ae expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.570534:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836563.570536:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836563.570538:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787836563.570549:0:12920:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787836563.570553:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787836563.570558:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787836563.570563:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1787836563.570569:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98e3ffdb8800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787836563.570575:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98e3ffdbf000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787836563.570582:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98e3ee576000 a64a6682-9f1f-4978-b16c-a7d486c0bf01 192.168.203.25@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787836563.570587:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98e2c2db2000 2cd520e4-f240-41e5-b585-08ee5ec96478 192.168.203.25@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:3.0:1787836563.570592:0:12920:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff98e3c69f3490) has exports, disconnecting them 00000020:00080000:3.0:1787836563.570602:0:12920:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98e3ffdb8800), last request at 1787836561 00000020:00000080:3.0:1787836563.570609:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab73bb 00000100:00080000:3.0:1787836563.570624:0:12920:0:(import.c:65:import_set_state_nolock()) ffff98e3d01ca800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787836563.570654:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787836563.570665:0:12920:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e3ffdb8800): rc 0 00000020:00000080:3.0:1787836563.570667:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ffdb8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787836563.570675:0:12920:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98e3ffdbf000), last request at 1787836561 00000020:00000080:3.0:1787836563.570679:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab72e2 00000100:00080000:3.0:1787836563.570684:0:12920:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdba800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787836563.570694:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787836563.570701:0:12920:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e3ffdbf000): rc 0 00000020:00000080:3.0:1787836563.570704:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ffdbf000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787836563.570709:0:12920:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0bac2c23ae0 00000100:00080000:3.0:1787836563.570727:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787836563.570730:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1787836563.570740:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787836563.570797:0:12920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787836563.570809:0:12920:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7e3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787836563.570819:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787836563.570820:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787836563.570828:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787836563.570904:0:12920:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787836563.570913:0:12920:0:(import.c:65:import_set_state_nolock()) ffff98e3f5ae5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787836563.570938:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98e3c69f3490) has no exports 00010000:00010000:2.0:1787836563.571649:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836563.571712:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:3313:x1874682193205888:12345-0@lo:103:ldlm_bl.0 Request processed in 2859us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836563.571720:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787836563.571769:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193206016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836563.571803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836563.571842:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193205888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836563.571859:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787836563.571874:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193206400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836563.571912:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787836563.571938:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836563.572247:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193206016 00000100:00100000:2.0:1787836563.572254:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193206016 00000100:00100000:2.0:1787836563.572288:0:7631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193206400 00000100:00100000:2.0:1787836563.572292:0:7631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193206400 00000100:00100000:2.0:1787836563.572312:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787836563.572320:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8e7a0a-4610-42c5-99e6-210da529f97c+19:3313:x1874682193206016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787836563.572331:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836563.572346:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f4400/0x966835ea68ab74d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab74cc expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836563.572357:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836563.572385:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8e7a0a-4610-42c5-99e6-210da529f97c+18:3313:x1874682193206016:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836563.572392:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787836563.572406:0:7631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787836563.572412:0:7631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d04e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:3313:x1874682193206400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787836563.572420:0:7631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836563.572428:0:7631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0031200/0x966835ea68ab71ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab71a7 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836563.572439:0:7631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836563.572460:0:7631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d04e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e8e7a0a-4610-42c5-99e6-210da529f97c+16:3313:x1874682193206400:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836563.572467:0:7631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787836563.572513:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193206400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836563.572530:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5ee92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193206016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836563.573231:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193206144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836563.573276:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836563.573311:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836563.573317:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193206272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836563.573336:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836563.573362:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193206144 00000100:00100000:1.0:1787836563.573367:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193206144 00000100:00100000:1.0:1787836563.573392:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193206272 00000100:00100000:1.0:1787836563.573395:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193206272 00000100:00100000:3.0:1787836563.573398:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787836563.573406:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2649680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:3310:x1874682193206144:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836563.573408:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787836563.573412:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+17:3310:x1874682193206272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787836563.573416:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836563.573418:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836563.573428:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ad400/0x966835ea68ab76ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab76e7 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836563.573438:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836563.573440:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c0030a00/0x966835ea68ab73fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab73f3 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836563.573459:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836563.573465:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:3310:x1874682193206272:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836563.573471:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787836563.573481:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2649680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e8e7a0a-4610-42c5-99e6-210da529f97c+15:3310:x1874682193206144:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836563.573486:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:1.0:1787836563.573546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ffdb8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787836563.573597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ffdbf000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787836563.573617:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3d01ca800 for lustre-MDT0000 00000020:00000080:1.0:1787836563.573622:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3ffdba800 for lustre-MDT0000 00000100:00100000:1.0:1787836563.573643:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193206272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836563.573661:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e8e7a0a-4610-42c5-99e6-210da529f97c:3310:1874682193206144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836563.573684:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193206528:0@lo:9:umount.0 00000100:00100000:1.0:1787836563.573713:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836563.573735:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193206656:0@lo:9:umount.0 00000100:00100000:1.0:1787836563.573754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836563.573782:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193206528 00000100:00100000:1.0:1787836563.573786:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193206528 00000100:00100000:1.0:1787836563.573810:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193206656 00000100:00100000:1.0:1787836563.573813:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193206656 00000100:00100000:1.0:1787836563.573841:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787836563.573848:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2648780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874682193206528:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787836563.573869:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab732f 00000100:00080000:1.0:1787836563.573877:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdbd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787836563.573917:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787836563.574113:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2648780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3309:x1874682193206528:12345-0@lo:9:umount.0 Request processed in 265us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836563.574120:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787836563.574133:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787836563.574140:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874682193206656:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787836563.574151:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7424 00000100:00080000:1.0:1787836563.574157:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98e3fabd7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787836563.574175:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787836563.574443:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3309:x1874682193206656:12345-0@lo:9:umount.0 Request processed in 303us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836563.574450:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787836563.574475:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787836563.574494:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836563.574514:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787836563.574535:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7e3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787836563.574548:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787836563.574550:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787836563.574554:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193206528:0@lo:9:umount.0 00000100:00080000:1.0:1787836563.574564:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3f5ae5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787836563.574573:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787836563.574574:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787836563.574577:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193206656:0@lo:9:umount.0 00000020:00080000:3.0:1787836563.583374:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98e3c69f3490) has no exports 00000020:00000080:3.0:1787836563.621336:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7202 00000020:00000080:3.0:1787836563.621352:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ee077800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787836563.621375:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787836563.621403:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ee077800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787836563.621508:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787836563.621518:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787836563.621523:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff98e3eeb18000) has no exports 00000020:00000080:2.0:1787836563.621823:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab71fb 00000020:00000080:2.0:1787836563.621829:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ef7e1800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787836563.621903:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787836563.621911:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787836563.621914:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3e8b21000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787836563.621917:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3e8b21000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787836563.621925:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787836563.622199:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ef7e1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787836563.630180:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787836563.782832:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787836563.782840:0:6718:0:(genops.c:885:class_export_put()) final put ffff98e3ffdbe000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787836563.782867:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:0.0:1787836563.782870:0:6718:0:(genops.c:885:class_export_put()) final put ffff98e3c404d800/2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:2.0:1787836563.782928:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ffdbe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787836563.782981:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3c404d800/2cd520e4-f240-41e5-b585-08ee5ec96478 for lustre-OST0000 00000020:00000080:2.0:1787836563.783000:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3ffdbd800 for lustre-OST0000 00000020:00000080:2.0:1787836563.783005:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3c4049800 for lustre-OST0000 00000001:00100000:2.0:1787836563.801477:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a64a6682-9f1f-4978-b16c-a7d486c0bf01 00000001:00080000:2.0:1787836563.801497:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787836563.801504:0:5864:0:(genops.c:885:class_export_put()) final put ffff98e3ee576000/a64a6682-9f1f-4978-b16c-a7d486c0bf01 00000001:00100000:2.0:1787836563.801524:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2cd520e4-f240-41e5-b585-08ee5ec96478 00000001:00080000:2.0:1787836563.801531:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787836563.801547:0:5864:0:(genops.c:885:class_export_put()) final put ffff98e2c2db2000/2cd520e4-f240-41e5-b585-08ee5ec96478 00000020:00000080:0.0:1787836563.801786:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ee576000/a64a6682-9f1f-4978-b16c-a7d486c0bf01 for lustre-MDT0000 00000020:00000080:0.0:1787836563.801846:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e2c2db2000/2cd520e4-f240-41e5-b585-08ee5ec96478 for lustre-MDT0000 00000020:00000080:0.0:1787836563.801872:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e401e6c800 for lustre-MDT0000 00000020:00000080:0.0:1787836563.801876:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e2c2db7800 for lustre-MDT0000 00010000:00010000:1.0:1787836564.654409:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836565.678459:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787836565.678942:0:12920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e3c8f70360 - data ffff98e3f03fd948/ffff98e3ef25e000 00000020:01000000:3.0:1787836565.679122:0:12920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e3c3376ea0 - data ffff98e3f172c438/ffff98e3d84db800 00000001:00000004:3.0:1787836565.698632:0:12920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787836565.854424:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787836565.854434:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1787836565.854448:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787836565.854451:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787836565.855053:0:6736:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787836565.855083:0:6736:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787836565.855095:0:6736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787836565.861712:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787836565.861722:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787836565.861744:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787836565.861747:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787836565.862924:0:7908:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787836565.862931:0:7908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1787836565.862942:0:7908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787836565.999710:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab71ca 00000020:00000080:0.0:1787836565.999724:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ee0b8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787836566.004780:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab71df 00000020:00000080:2.0:1787836566.004812:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3e8b21800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787836566.004822:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787836566.004829:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787836566.004838:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787836566.004842:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff98e3c69f4ed8) has no exports 00000004:01000000:2.0:1787836566.006322:0:12920:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787836566.006335:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab741d 00000020:00000080:2.0:1787836566.006344:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3d8289000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787836566.006351:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787836566.006358:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787836566.006369:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787836566.006373:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff98e2c1803490) has no exports 00000020:00000080:2.0:1787836566.006382:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7416 00000020:00000080:2.0:1787836566.006387:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3f5ae2000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787836566.006746:0:12920:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787836566.006751:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787836566.006756:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787836566.006763:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787836566.006765:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787836566.006796:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787836566.006804:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787836566.006812:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7328 00000020:00000080:2.0:1787836566.006818:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3d01ce800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787836566.006822:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787836566.006825:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787836566.006829:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787836566.006832:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff98e3d83e9a48) has no exports 00000020:00000080:2.0:1787836566.006836:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7321 00000020:00000080:2.0:1787836566.006838:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ef7e0800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787836566.008376:0:12920:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787836566.008386:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787836566.008391:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1787836566.008413:0:12920:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787836566.008415:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787836566.008464:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787836566.008476:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787836566.008511:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787836566.008515:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787836566.008546:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab71e6 00000020:00000080:2.0:1787836566.008555:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3e8b22800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787836566.008561:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787836566.008565:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787836566.008570:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787836566.008574:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff98e3eeb19a48) has no exports 00000020:00000080:2.0:1787836566.008594:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787836566.008597:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787836566.008602:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab71ed 00000020:00000080:2.0:1787836566.008606:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3e8b27000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787836566.008614:0:12920:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e3ce1d0800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787836566.008617:0:12920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e3ce1d0800 3 00000020:01000004:2.0:1787836566.008620:0:12920:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e3ce1d0800 from lustre-MDT0000 00000020:00000080:2.0:1787836566.008642:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787836566.008646:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787836566.008649:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ee0bd800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787836566.008652:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ee0bd800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787836566.008661:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787836566.008728:0:12920:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787836566.008732:0:12920:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787836566.008735:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787836566.008738:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787836566.008740:0:12920:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787836566.008747:0:12920:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff98e3c5c86800 2e8e7a0a-4610-42c5-99e6-210da529f97c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787836566.008752:0:12920:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff98e3c7fa8000) has exports, disconnecting them 00000020:00080000:2.0:1787836566.008756:0:12920:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98e3c5c86800), last request at 1787836325 00000020:00000080:2.0:1787836566.008777:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab718b 00000020:00010000:2.0:1787836566.008781:0:12920:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98e3c5c86800: total 8 00000100:00080000:2.0:1787836566.008786:0:12920:0:(import.c:65:import_set_state_nolock()) ffff98e3c5c81000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787836566.008812:0:12920:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e3c5c86800): rc 0 00000020:00080000:2.0:1787836566.008816:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff98e3c7fa8000) has no exports 00000020:00010000:2.0:1787836566.008842:0:7633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98e3c5c86800: total 8 00010000:00010000:2.0:1787836566.008868:0:7633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98e3c5c86800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787836566.008912:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13adc00/0x966835ea68ab76e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab76d9 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836566.008929:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ad600/0x966835ea68ab76d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab76cb expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836566.008944:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c152b400/0x966835ea68ab7295 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab728e expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836566.008958:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab74e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab74da expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836566.008967:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005a600/0x966835ea68ab749b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab7494 expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836566.008976:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab748d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab7486 expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836566.008987:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005b400/0x966835ea68ab74a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab74a2 expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836566.008996:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005a400/0x966835ea68ab74b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x966835ea68ab74b0 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836566.009005:0:7633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98e3c5c86800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787836566.009023:0:7633:0:(genops.c:885:class_export_put()) final put ffff98e3c5c86800/2e8e7a0a-4610-42c5-99e6-210da529f97c 00010000:00010000:2.0:1787836566.009028:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836566.009030:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836566.009032:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836566.009159:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98e3dbc6a400:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1787836566.009244:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98e3dbc6bc00:5835] 1 exiting: rc = 0 00000020:00000080:1.0:1787836566.009586:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ee0b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787836566.009605:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3e8b21800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787836566.009611:0:1360:0:(genops.c:885:class_export_put()) final put ffff98e3ee0bf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787836566.009613:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ee0bf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787836566.009618:0:1360:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787836566.009765:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d8289000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787836566.009772:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3f5ae2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787836566.009778:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3f5ae5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787836566.009784:0:1360:0:(genops.c:885:class_export_put()) final put ffff98e3d8288000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787836566.009786:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d8288000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787836566.009789:0:1360:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787836566.009818:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d01ce800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787836566.009826:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ef7e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787836566.009841:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3ef7e3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787836566.009866:0:1360:0:(genops.c:885:class_export_put()) final put ffff98e3f7ae4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787836566.009869:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3f7ae4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787836566.009882:0:1360:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787836566.009967:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3e8b22800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787836566.009972:0:1360:0:(genops.c:885:class_export_put()) final put ffff98e3cdc22000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787836566.009974:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3cdc22000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787836566.009977:0:1360:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787836566.010164:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3e8b27000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787836566.010179:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3c5c86800/2e8e7a0a-4610-42c5-99e6-210da529f97c for MGS 00000020:00000080:1.0:1787836566.010217:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3c5c81000 for MGS 00000100:00100000:1.0:1787836566.010615:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98e3dbc6ac00:5833] 0 exiting: rc = 1 00000100:00100000:1.0:1787836566.010712:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010719:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010725:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010731:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010736:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010741:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010747:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010752:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010758:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010764:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010771:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010777:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010782:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010789:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010795:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010800:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010806:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010811:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010816:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010822:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010828:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.010846:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011223:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011305:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011311:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011319:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011325:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011331:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011336:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011342:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011347:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011354:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011360:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011365:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011370:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011376:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011381:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011387:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011392:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011398:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011402:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011407:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011413:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011419:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011425:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011431:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011437:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011443:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011527:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011532:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011538:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011543:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011547:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011552:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011557:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011563:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011579:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011585:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011591:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011597:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011602:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011608:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011615:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836566.011630:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787836566.013320:0:12920:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787836566.013328:0:12920:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787836566.016644:0:12920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e3c8c608a0 - data ffff98e3f175c1b0/ffff98e2c134a400 00000020:01000000:1.0:1787836566.016812:0:12920:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e3c6999300 - data ffff98e3f1726bd0/ffff98e3c5c9b800 00000020:00000080:1.0:1787836566.018640:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab716f 00000020:00000080:1.0:1787836566.018650:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3d000a800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787836566.018721:0:12920:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e3ce1d0800 from MGS, refs=2 00000020:01000004:1.0:1787836566.018734:0:12920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e3ce1d0800 2 00000020:01000004:1.0:1787836566.018738:0:12920:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e3ce1d0800 from MGS 00000020:00000080:1.0:1787836566.018762:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787836566.018770:0:12920:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787836566.018773:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3d000a000/MGS 00000020:00000080:1.0:1787836566.018776:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d000a000/MGS for MGS 00000020:01000000:1.0:1787836566.018783:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787836566.018844:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787836566.018849:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787836566.018864:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787836566.018880:0:12920:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98e3ef7f8000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787836566.018886:0:12920:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff98e3eeb1ced8) has exports, disconnecting them 00000020:00080000:1.0:1787836566.018891:0:12920:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98e3ef7f8000), last request at 1787836325 00000020:00000080:1.0:1787836566.018896:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab723a 00000020:00080000:1.0:1787836566.018905:0:12920:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e3ef7f8000): rc 0 00000020:00000080:1.0:1787836566.018910:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ef7f8000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787836566.027287:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d000a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787836566.029106:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ef7f8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787836566.034370:0:12920:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787836566.034381:0:12920:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787836566.034384:0:12920:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787836566.034393:0:12920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787836566.034618:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787836566.034629:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787836566.034638:0:12920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e3ce1d0800 1 00000020:00000080:0.0:1787836566.034661:0:12920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7161 00000020:00000080:0.0:1787836566.034671:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3d000c800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787836566.034678:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787836566.034685:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787836566.034690:0:12920:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787836566.034694:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98e3c69f1a48) has no exports 00000020:00000080:2.0:1787836566.034770:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3ef7fd800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787836566.034777:0:36:0:(genops.c:885:class_export_put()) final put ffff98e3ef7e7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787836566.034779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ef7e7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787836566.034790:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787836566.034859:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d000c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787836566.060913:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787836566.060928:0:12920:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787836566.060933:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3ce1d7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787836566.060939:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ce1d7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787836566.060948:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787836566.061128:0:12920:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98e3ce1d3000 00000020:01000000:0.0:1787836566.061154:0:12920:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787836566.061158:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787836566.061162:0:12920:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787836566.061166:0:12920:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff98e3c69f0000) has no exports 00000100:00100000:0.0:1787836566.061369:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98e3d3b25a00:5843] 2 exiting: rc = 0 00000100:00100000:0.0:1787836566.061608:0:10086:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98e3c7f6c200:10086] 3 exiting: rc = 0 00000100:00100000:0.0:1787836566.061672:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98e3d3b25600:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1787836566.065032:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98e3d3b24a00:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1787836566.065192:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065201:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065208:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065214:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065221:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065226:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065363:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065370:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065376:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065382:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065387:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065394:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065400:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065432:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065438:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065515:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065525:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065531:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065537:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065542:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065549:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065555:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065562:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065568:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065574:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065579:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065585:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065592:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065597:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065603:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065610:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065615:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065622:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065627:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065632:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065638:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065662:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065670:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065677:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065683:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065690:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065695:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065701:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065706:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065713:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065719:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065724:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065731:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065744:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065750:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065756:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065761:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065768:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065774:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065779:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065784:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065790:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065796:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065802:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065808:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065814:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065821:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065826:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.065839:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.075269:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98e3ce130000:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1787836566.077246:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98e3d01e2000:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1787836566.077480:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077488:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077495:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077502:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077507:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077513:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077519:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077524:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077530:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077536:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077542:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077548:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077555:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077560:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077565:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077570:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077576:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077602:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077607:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077612:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077628:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077635:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077641:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077648:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077653:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077659:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077664:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077669:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077674:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077678:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077683:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077688:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077693:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077698:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077704:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077709:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077715:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077720:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077726:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077731:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077737:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077743:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077748:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077753:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077757:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077762:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077766:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077771:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077777:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077782:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077787:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077793:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077806:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077811:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077817:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077821:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077827:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077832:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077843:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077849:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077853:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077859:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077865:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.077879:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.078297:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98e3d01e2600:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787836566.078727:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98e3d01e2400:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1787836566.079618:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079626:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079649:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079658:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079668:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079675:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079681:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079688:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079694:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079700:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079705:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079711:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079716:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079722:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079744:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079750:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079758:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079763:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079770:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079776:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079781:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079787:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079803:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079809:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079816:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079822:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079827:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079846:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079853:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079859:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079865:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079880:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079886:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079892:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079899:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079905:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079911:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079917:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079923:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079942:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079949:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079955:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079962:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079968:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079974:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079980:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079986:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079991:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.079997:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080004:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080013:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080036:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080045:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080053:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080090:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080099:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080106:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080119:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080127:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080134:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080141:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080147:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080155:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.080162:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.104552:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98e3c5c93400:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1787836566.123210:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98e3c5c92a00:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1787836566.123552:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123560:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123567:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123573:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123581:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123597:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123603:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123608:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123614:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123619:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123625:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123631:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123636:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123642:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123647:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123653:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123658:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123664:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123670:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123676:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123682:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123687:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123692:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123698:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123702:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123708:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123713:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123717:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123742:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123747:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123753:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123758:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123762:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123767:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123772:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123777:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123781:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123788:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123794:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123799:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123804:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123808:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123814:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123820:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123825:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123830:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123836:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123841:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123846:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123851:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123856:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123860:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123865:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123878:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123884:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123890:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123895:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123899:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123904:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123909:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123914:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123919:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123923:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.123936:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.125007:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98e3c5c93000:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1787836566.125140:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98e3c5c92800:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1787836566.125245:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125252:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125257:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125263:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125268:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125274:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125279:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125285:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125293:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125298:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125304:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125308:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125314:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125319:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125325:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125330:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125336:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125341:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125348:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125353:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125359:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125365:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125370:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125378:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125383:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125388:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125394:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125400:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125405:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125422:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125428:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125433:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125437:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125441:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125468:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125473:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125478:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125484:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125489:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125494:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125500:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125506:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125512:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125517:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125522:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125528:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125534:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125539:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125545:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125550:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125555:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125560:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125566:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125571:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125577:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125582:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125598:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125603:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125609:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125614:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125620:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125625:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125630:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.125635:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126041:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98e3d01c1000:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1787836566.126686:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98e3d01c0800:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1787836566.126832:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126839:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126843:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126848:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126865:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126886:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126893:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126899:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126904:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126910:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126915:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126921:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126926:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126931:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126937:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126942:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126947:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126952:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126957:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126962:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126968:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126972:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126978:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126983:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126989:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126993:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.126999:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127004:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127009:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127015:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127020:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127026:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127031:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127037:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127043:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127049:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127080:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127087:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127093:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127106:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127111:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127117:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127122:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127126:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127131:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127136:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127141:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127146:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127152:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127156:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127161:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127393:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127405:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127419:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127425:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127431:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127436:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127441:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127456:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127461:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127467:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127472:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127478:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.127484:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787836566.128729:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98e3ce130600:5854] 0 exiting: rc = 1 00000100:00100000:2.0:1787836566.129350:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98e3ce131a00:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1787836566.129810:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98e3c827d800:5856] 2 exiting: rc = 0 00000100:00100000:2.0:1787836566.129896:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129905:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129911:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129933:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129941:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129947:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129953:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129960:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129982:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129988:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.129994:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130001:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130006:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130011:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130016:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130022:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130027:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130033:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130038:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130043:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130049:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130055:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130085:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130091:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130096:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130102:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130109:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130129:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130136:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130142:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130148:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130154:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130160:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130166:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130313:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130322:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130333:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130339:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130347:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130354:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130361:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130367:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130373:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130387:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130393:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130400:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130405:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130661:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130670:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130678:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130684:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130708:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130716:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130722:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130729:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130736:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130743:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130749:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130756:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130761:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130770:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130778:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130785:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836566.130800:0:12920:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787836566.136961:0:12920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787836566.136977:0:12920:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787836566.136983:0:12920:0:(genops.c:885:class_export_put()) final put ffff98e3c7ff2000/MDS_uuid 00000020:00000080:2.0:1787836566.136987:0:12920:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3c7ff2000/MDS_uuid for MDS 00000020:01000000:2.0:1787836566.136994:0:12920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787836566.137187:0:12920:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1787836566.272959:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193206784:0@lo:400:kworker.0 00000400:00000100:2.0:1787836566.273015:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874682193206784 offset 0 length 224: 4 00000100:00100000:1.0:1787836566.274697:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193206912:0@lo:400:kworker.0 00000400:00000100:1.0:1787836566.274766:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874682193206912 offset 0 length 224: 4 00000100:00100000:1.0:1787836566.274800:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836566.274807:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193207040:0@lo:400:kworker.0 00000400:00000100:1.0:1787836566.274833:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874682193207040 offset 0 length 224: 4 00010000:00010000:2.0:1787836566.706633:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787836567.319000:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787836567.319014:0:7644:0:(genops.c:885:class_export_put()) final put ffff98e3fabd0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787836567.319280:0:1360:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3fabd0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787836567.319330:0:1360:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3fabd7800 for lustre-OST0001 00010000:00010000:0.0:1787836567.726352:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836568.751287:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787836569.689584:0:13075:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787836569.708400:0:13075:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787836569.708513:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836569.708529:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836569.708547:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836569.708554:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836569.708642:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787836569.708647:0:13075:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787836569.708667:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787836569.708678:0:13075:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e3fadc3c00 x1874682193206912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836582 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836569.708692:0:13075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787836569.708697:0:13075:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787836569.708718:0:13075:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdbb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787836569.708791:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836569.708798:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836569.708806:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030400 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836569.708810:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836569.708818:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836569.708825:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836569.708832:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787836569.708834:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787836569.708837:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787836569.708876:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836569.708883:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836569.708904:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836569.708911:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab74a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x966835ea68ab74a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836569.708932:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836569.708934:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836569.708935:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836569.708964:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193206912:0@lo:400:kworker.0 00000100:00100000:1.0:1787836569.708993:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874682193207168:0@lo:39:umount.0 00000400:00000100:1.0:1787836569.709051:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874682193207168 offset 0 length 224: 4 00000100:00100000:2.0:1787836569.709099:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787836569.709110:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193207296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836569.709147:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836569.709686:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193207296 00000100:00100000:1.0:1787836569.709694:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193207296 00000100:00100000:1.0:1787836569.709744:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787836569.709751:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1874682193207296:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787836569.709757:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787836569 with bad export cookie 10837971784161784203 00000100:00100000:1.0:1787836569.722574:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1874682193207296:12345-0@lo:103:ldlm_bl.0 Request processed in 12748us (13352us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787836569.722592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787836569.724707:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787836569.724714:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98e3d000f800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787836569.724718:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787836569.741413:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.125@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787836569.741420:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787836569.741431:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e3fadc0f00 x1874682193206784/t0(0) o400->MGC192.168.203.125@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787836582 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836569.741447:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e2c2648f00 x1874682193207296/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787836585 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787836569.741457:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787836569.741460:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787836569.741462:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787836569.741466:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98e3d000f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787836569.741471:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1787836569.741480:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.203.125@tcp: import ffff98e3d000f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1787836569.741515:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3fadd1a40 x1874682193207424/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787836569.741558:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193206784:0@lo:400:kworker.0 00000100:00100000:2.0:1787836569.741590:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e8e7a0a-4610-42c5-99e6-210da529f97c:3313:1874682193207296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836569.742160:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8e7a0a-4610-42c5-99e6-210da529f97c:3309:1874682193207424:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1787836569.742215:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874682193207424 offset 0 length 520: 4 00010000:00010000:2.0:1787836569.775616:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836570.798190:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787836571.374370:0:1360:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787836571.374381:0:1360:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787836571.374603:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836571.374624:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193207552:0@lo:400:kworker.0 00000400:00000100:0.0:1787836571.374675:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874682193207552 offset 0 length 224: 4 00010000:00010000:1.0:1787836571.822446:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836572.846232:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836573.871720:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836574.894386:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787836575.406225:0:1360:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787836575.406237:0:1360:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787836575.406397:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787836575.406419:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193207680:0@lo:400:kworker.0 00000400:00000100:0.0:1787836575.406486:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874682193207680 offset 0 length 224: 4 00010000:00010000:2.0:1787836575.918214:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836576.942707:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836577.966285:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836578.990260:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836579.054511:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787836569/real 1787836569] req@ffff98e3fadd1a40 x1874682193207424/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787836579 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836579.054540:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e3fadd1a40 x1874682193207424/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787836579 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836579.054552:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787836569/real 1787836569] req@ffff98e3fadc3480 x1874682193207168/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787836579 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836579.054579:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e3fadc3480 x1874682193207168/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787836579 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787836579.054598:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3d000f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787836579.054620:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787836579.054623:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8e7a0a-4610-42c5-99e6-210da529f97c:3309:1874682193207424:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1787836579.054630:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdbb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787836579.054646:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874682193207168:0@lo:39:umount.0 00000100:00080000:0.0:1787836579.054730:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787836579.054735:0:13075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787836579.054740:0:13075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787836579.055690:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836579.055719:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836579.055726:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836579.055733:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836579.055764:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836579.055771:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836579.055787:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836579.055793:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836579.055799:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836579.055810:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787836579.055815:0:13075:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787836579.055845:0:13075:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787836579.055849:0:13075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787836579.055854:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787836579.055859:0:13075:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787836579.055863:0:13075:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98e3eeb1b490) has no exports 00000020:00080000:0.0:1787836579.055899:0:13075:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98e3eeb1b490) has no exports 00000100:00080000:2.0:1787836579.057425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787836579.057433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787836579.057438:0:36:0:(import.c:65:import_set_state_nolock()) ffff98e3d000f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787836579.057446:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 418 00000100:00080000:2.0:1787836579.057452:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787836579.057459:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.125@tcp: import ffff98e3d000f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1787836579.057493:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3fadd3c00 x1874682193207808/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787836579.057567:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193207936:0@lo:400:kworker.0 00000400:00000100:2.0:1787836579.057619:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874682193207936 offset 0 length 224: 4 00010000:00010000:1.0:1787836579.057983:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836579.058002:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836579.058012:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5400 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836579.058016:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836579.058026:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836579.058034:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836579.058040:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787836579.058044:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787836579.058047:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787836579.058096:0:7633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e3d000f800 00010000:00010000:1.0:1787836579.058101:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836579.058123:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5400/0x966835ea68ab74b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab74b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836579.058137:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836579.058142:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836579.058148:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836579.058151:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836579.058158:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836579.058164:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836579.058170:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787836579.058172:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787836579.058174:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787836579.058180:0:7633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e3d000f800 00010000:00010000:1.0:1787836579.058183:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836579.058189:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0031600/0x966835ea68ab76d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab76e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836579.058196:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836579.058198:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836579.058206:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836579.058213:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836579.058234:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8e7a0a-4610-42c5-99e6-210da529f97c:3309:1874682193207808:0@lo:250:kworker.0 00000400:00000100:1.0:1787836579.058264:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874682193207808 offset 0 length 520: 4 00000020:01000000:0.0:1787836579.066972:0:13075:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e3fb9f6780 - data ffff98e3ffe99798/ffff98e2c18e6c00 00000020:01000000:0.0:1787836579.067358:0:13075:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e3d8584c60 - data ffff98e3f173a870/ffff98e2c1d52400 00100000:10000000:2.0:1787836579.077171:0:13075:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787836579.125026:0:13075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab72b1 00000020:00000080:0.0:1787836579.125036:0:13075:0:(genops.c:885:class_export_put()) final put ffff98e3fabd0800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787836579.125962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3fabd0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1787836579.126830:0:13075:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e3d01b2000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787836579.126837:0:13075:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e3d01b2000 2 00000020:01000004:0.0:1787836579.126840:0:13075:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e3d01b2000 from lustre-OST0000 00000020:00000080:0.0:1787836579.127302:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787836579.127326:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787836579.127336:0:13075:0:(genops.c:885:class_export_put()) final put ffff98e3fabd5800/lustre-OST0000_UUID 00000020:00000080:0.0:1787836579.127340:0:13075:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3fabd5800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787836579.127349:0:13075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787836579.127487:0:13075:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787836579.127492:0:13075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787836579.127497:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787836579.127502:0:13075:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787836579.127513:0:13075:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98e3ffdb8000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787836579.127519:0:13075:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff98e3f5800000) has exports, disconnecting them 00000020:00080000:0.0:1787836579.127525:0:13075:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98e3ffdb8000), last request at 1787836341 00000020:00000080:0.0:1787836579.127530:0:13075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab72db 00000020:00080000:0.0:1787836579.127542:0:13075:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e3ffdb8000): rc 0 00000020:00000080:0.0:1787836579.127547:0:13075:0:(genops.c:885:class_export_put()) final put ffff98e3ffdb8000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787836579.127717:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ffdb8000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787836579.131139:0:13075:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787836579.131147:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787836579.131151:0:13075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787836579.131158:0:13075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787836579.131370:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787836579.131538:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787836579.131548:0:13075:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e3d01b2000 1 00000020:00000080:1.0:1787836579.131557:0:13075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab726b 00000020:00000080:1.0:1787836579.131567:0:13075:0:(genops.c:885:class_export_put()) final put ffff98e3d01b2800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787836579.131574:0:13075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787836579.131583:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787836579.131589:0:13075:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787836579.131594:0:13075:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff98e3c7fab490) has no exports 00000020:00000080:3.0:1787836579.131942:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3ffdbb000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787836579.131952:0:36:0:(genops.c:885:class_export_put()) final put ffff98e3ee43a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787836579.131955:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3ee43a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787836579.131971:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787836579.132038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d01b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787836579.167804:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787836579.167819:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787836579.167825:0:13075:0:(genops.c:885:class_export_put()) final put ffff98e3d01b1800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787836579.167829:0:13075:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d01b1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787836579.167842:0:13075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787836579.170634:0:13075:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98e3d01b5000 00000020:02000400:1.0:1787836579.170701:0:13075:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787836580.015804:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836581.038934:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787836581.843707:0:13228:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787836581.861047:0:13228:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787836581.861313:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836581.861345:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836581.861353:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836581.861360:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836581.861384:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787836581.861390:0:13228:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787836581.861414:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787836581.861427:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e3fadc21c0 x1874682193207040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836582 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836581.861452:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e2c3788780 x1874682193207552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836587 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836581.861467:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e2c3788f00 x1874682193207680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836591 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836581.861481:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e3fadd1a40 x1874682193207936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836595 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836581.861488:0:13228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787836581.861490:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193207040:0@lo:400:kworker.0 00000100:00080000:3.0:1787836581.861494:0:13228:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787836581.861518:0:13228:0:(import.c:65:import_set_state_nolock()) ffff98e401d42000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787836581.861523:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193207936:0@lo:400:kworker.0 00000100:00100000:2.0:1787836581.861530:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874682193207680:0@lo:400:kworker.0 00010000:00010000:0.0:1787836581.862091:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836581.862102:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836581.862111:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005b000 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836581.862116:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836581.862139:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836581.862146:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836581.862151:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787836581.862153:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787836581.862156:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787836581.862185:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e3d000f800 00010000:00010000:0.0:1787836581.862189:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836581.862195:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab7486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab748d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836581.862207:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836581.862209:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836581.862211:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836581.862711:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874682193207552:0@lo:400:kworker.0 00000100:00100000:1.0:1787836581.863880:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c37883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874682193208064:0@lo:39:umount.0 00000400:00000100:1.0:1787836581.863931:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874682193208064 offset 0 length 224: 4 00010000:00010000:2.0:1787836582.062244:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836583.086381:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836584.110620:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787836584.174516:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787836584.174527:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787836585.134449:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836586.164190:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836587.182214:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836588.206976:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836589.230620:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787836589.296252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787836589.296275:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787836590.254528:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836591.022300:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787836581/real 1787836581] req@ffff98e2c37883c0 x1874682193208064/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787836591 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836591.022339:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e2c37883c0 x1874682193208064/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787836591 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787836591.022362:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e401d42000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787836591.022392:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c37883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874682193208064:0@lo:39:umount.0 00000100:00080000:3.0:1787836591.022634:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787836591.022653:0:13228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787836591.022658:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787836591.024644:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836591.024721:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836591.024731:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836591.024737:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836591.024766:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836591.024773:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836591.024780:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836591.024786:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836591.024792:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836591.024812:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787836591.024816:0:13228:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787836591.024838:0:13228:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787836591.024842:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787836591.024858:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787836591.024864:0:13228:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787836591.024867:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98e3d83e8000) has no exports 00000020:00080000:3.0:1787836591.024892:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98e3d83e8000) has no exports 00010000:00010000:1.0:1787836591.025529:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836591.025538:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.025546:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836591.025549:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.025557:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836591.025563:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836591.025569:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787836591.025571:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787836591.025573:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787836591.025588:0:7633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e3d000f800 00010000:00010000:1.0:1787836591.025592:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.025611:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4600/0x966835ea68ab7494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab749b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.025624:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836591.025627:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.025633:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005ba00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836591.025637:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.025644:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836591.025650:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836591.025655:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787836591.025657:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787836591.025673:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787836591.025679:0:7633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e3d000f800 00010000:00010000:1.0:1787836591.025682:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.025688:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab76cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab76d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.025709:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836591.025711:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836591.025719:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836591.025724:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787836591.034269:0:13228:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e3fb9f6d80 - data ffff98e3ffe99a20/ffff98e2c18e7800 00000020:01000000:3.0:1787836591.034469:0:13228:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98e3c8c60060 - data ffff98e3f0250510/ffff98e3eea93400 00100000:10000000:3.0:1787836591.043777:0:13228:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787836591.094595:0:13228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab738a 00000020:00000080:1.0:1787836591.094604:0:13228:0:(genops.c:885:class_export_put()) final put ffff98e3c833c000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787836591.094615:0:13228:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e2c1c4b800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787836591.094618:0:13228:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e2c1c4b800 2 00000020:01000004:1.0:1787836591.094621:0:13228:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98e2c1c4b800 from lustre-OST0001 00000020:00000080:1.0:1787836591.094647:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787836591.094658:0:13228:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787836591.094661:0:13228:0:(genops.c:885:class_export_put()) final put ffff98e3c833b800/lustre-OST0001_UUID 00000020:00000080:1.0:1787836591.094664:0:13228:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3c833b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787836591.094673:0:13228:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1787836591.095169:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3c833c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1787836591.095472:0:13228:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2e8e7a0a-4610-42c5-99e6-210da529f97c->MGS 00010000:00010000:1.0:1787836591.095493:0:13228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0031400/0x966835ea68ab728e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab7295 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836591.095507:0:13228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0031400/0x966835ea68ab728e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab7295 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836591.095514:0:13228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787836591.095517:0:13228:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787836591.095521:0:13228:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787836591.095538:0:13228:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e3d000f800 00010000:00010000:1.0:1787836591.095542:0:13228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0031400/0x966835ea68ab728e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab7295 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836591.095557:0:13228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x966835ea68ab74e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836591.095564:0:13228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x966835ea68ab74e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836591.095569:0:13228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787836591.095581:0:13228:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787836591.095583:0:13228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787836591.095593:0:13228:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98e3d000f800 00010000:00010000:1.0:1787836591.095595:0:13228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab74da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x966835ea68ab74e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787836591.095612:0:13228:0:(import.c:65:import_set_state_nolock()) ffff98e3d000f800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787836591.095615:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787836591.095617:0:13228:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787836591.095619:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787836591.095622:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787836591.095632:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98e3fadd3c00 x1874682193207808/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787836594 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787836591.095653:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787836591.095656:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1787836591.095777:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e8e7a0a-4610-42c5-99e6-210da529f97c:3309:1874682193207808:0@lo:250:kworker.0 10000000:01000000:1.0:1787836591.095968:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787836591.095975:0:13228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab717d 00000020:00000080:1.0:1787836591.095983:0:13228:0:(genops.c:885:class_export_put()) final put ffff98e3c7ff3800/2e8e7a0a-4610-42c5-99e6-210da529f97c 00000020:01000000:1.0:1787836591.096005:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.125@tcp (flags='') 00000020:00000080:1.0:1787836591.096011:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787836591.096019:0:13228:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787836591.096024:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff98e3c7faced8) has no exports 00000020:00000080:2.0:1787836591.096179:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3c7ff3800/2e8e7a0a-4610-42c5-99e6-210da529f97c for MGC192.168.203.125@tcp 10000000:01000000:1.0:1787836591.096317:0:13228:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.125@tcp: client import never connected 00000100:00080000:1.0:1787836591.096320:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787836591.096336:0:5839:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787836591.096438:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787836591.096442:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787836591.096444:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787836591.096496:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787836591.096504:0:13228:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.125@tcp (uuid 2e8e7a0a-4610-42c5-99e6-210da529f97c) 00000020:01000000:1.0:1787836591.096509:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787836591.096513:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787836591.096517:0:13228:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787836591.096523:0:13228:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98e2c2db1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787836591.096538:0:13228:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff98e3d8281a48) has exports, disconnecting them 00000020:00080000:1.0:1787836591.096542:0:13228:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98e2c2db1000), last request at 1787836361 00000020:00000080:1.0:1787836591.096546:0:13228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab73b4 00000020:00080000:1.0:1787836591.096558:0:13228:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98e2c2db1000): rc 0 00000020:00000080:1.0:1787836591.096562:0:13228:0:(genops.c:885:class_export_put()) final put ffff98e2c2db1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787836591.097107:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e3d000f800 for MGC192.168.203.125@tcp 00000020:00000080:2.0:1787836591.097116:0:36:0:(genops.c:885:class_export_put()) final put ffff98e3d000f000/2e8e7a0a-4610-42c5-99e6-210da529f97c 00000020:00000080:2.0:1787836591.097119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d000f000/2e8e7a0a-4610-42c5-99e6-210da529f97c for MGC192.168.203.125@tcp 00000020:01000000:2.0:1787836591.097124:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.125@tcp (2e8e7a0a-4610-42c5-99e6-210da529f97c) 00000020:00000080:2.0:1787836591.097376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e2c2db1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787836591.108187:0:13228:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787836591.108196:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787836591.108200:0:13228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787836591.108207:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787836591.108369:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98e401d42000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787836591.111939:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787836591.112121:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787836591.112357:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787836591.112900:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98e3ce390200:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1787836591.174191:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98e3ce390e00:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1787836591.174363:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.174638:0:7632:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff98e3fba33a00:7632] 4 exiting: rc = 0 00000100:00100000:3.0:1787836591.174684:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98e3ce390a00:5827] 1 exiting: rc = 0 00000100:00100000:2.0:1787836591.174741:0:7631:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98e3f5ca1c00:7631] 3 exiting: rc = 0 00000100:00100000:0.0:1787836591.177289:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98e3ce390c00:5828] 2 exiting: rc = 0 00000100:00100000:0.0:1787836591.192218:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98e3ce391800:5826] 0 exiting: rc = 1 00000100:00100000:2.0:1787836591.192300:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192312:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192321:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192327:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192334:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192341:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192349:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192357:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192367:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192374:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192393:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192399:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192404:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192410:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192417:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192436:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192443:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192448:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192453:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192458:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192463:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192468:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192473:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192478:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192483:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192488:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192493:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192499:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192504:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192509:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192515:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192520:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192525:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192531:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192537:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192542:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192547:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192552:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192557:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192561:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192566:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192570:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192575:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192579:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192583:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192587:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192592:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192597:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192602:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192606:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192619:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192624:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192629:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192634:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192639:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192645:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192650:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192655:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192670:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192676:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192681:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192687:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192692:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.192712:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787836591.199748:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787836591.199760:0:13228:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787836591.199765:0:13228:0:(genops.c:885:class_export_put()) final put ffff98e401d40800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787836591.199769:0:13228:0:(genops.c:844:class_export_destroy()) destroying export ffff98e401d40800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787836591.199774:0:13228:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787836591.199813:0:13228:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e2c1c4b800 1 00000020:00000080:2.0:1787836591.199818:0:13228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x966835ea68ab7359 00000020:00000080:2.0:1787836591.199823:0:13228:0:(genops.c:885:class_export_put()) final put ffff98e3f5ae6000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787836591.199838:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787836591.199842:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787836591.199846:0:13228:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787836591.199850:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff98e3d8283490) has no exports 00000020:00000080:3.0:1787836591.199933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3f5ae6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787836591.227557:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787836591.227575:0:13228:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787836591.227581:0:13228:0:(genops.c:885:class_export_put()) final put ffff98e2c1c4a800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787836591.227585:0:13228:0:(genops.c:844:class_export_destroy()) destroying export ffff98e2c1c4a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787836591.227592:0:13228:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787836591.227944:0:13228:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98e2c1c4f800 00000020:01000000:3.0:1787836591.227965:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787836591.227969:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787836591.227974:0:13228:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787836591.227978:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff98e3c7fa9a48) has no exports 00000020:00000080:3.0:1787836591.228016:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787836591.228024:0:13228:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787836591.228027:0:13228:0:(genops.c:885:class_export_put()) final put ffff98e3d01b0000/OSS_uuid 00000020:00000080:3.0:1787836591.228030:0:13228:0:(genops.c:844:class_export_destroy()) destroying export ffff98e3d01b0000/OSS_uuid for OSS 00000020:01000000:3.0:1787836591.228037:0:13228:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1787836591.228653:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787836591.229486:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98e3ee563c00:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1787836591.229621:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98e3ee562600:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1787836591.229671:0:10087:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98e3c7f6d600:10087] 3 exiting: rc = 0 00000100:00100000:1.0:1787836591.229785:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98e3ee562a00:6693] 2 exiting: rc = 0 00000100:00100000:3.0:1787836591.232766:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232789:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232807:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232814:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232820:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232825:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232830:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232836:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232841:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232846:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232851:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232857:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232861:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232867:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232874:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232879:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232884:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232889:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232893:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232899:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232904:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232908:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232913:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232918:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232922:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232926:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232931:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232936:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232941:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232948:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232953:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232957:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232963:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232968:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232973:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232978:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.232989:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233007:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233013:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233018:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233024:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233029:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233035:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233041:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233047:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233053:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233082:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233087:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233092:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233097:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233101:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233106:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233111:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233116:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233121:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233126:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233131:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233135:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233141:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233147:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233152:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233157:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233163:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.233170:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.236468:0:12890:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98e3fb982e00:12890] 2 exiting: rc = 0 00000100:00100000:1.0:1787836591.236577:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98e3ee563800:6695] 1 exiting: rc = 0 00000100:00100000:2.0:1787836591.236743:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98e3ee563600:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1787836591.236833:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236842:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236851:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236858:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236864:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236869:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236873:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236891:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236897:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236902:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236907:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236913:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236919:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236924:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236929:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236935:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236939:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236944:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236949:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236954:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236960:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236965:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.236970:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237333:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237343:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237349:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237355:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237361:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237366:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237372:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237378:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237384:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237389:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237395:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237401:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237409:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237415:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237423:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237431:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237441:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237447:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237453:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237610:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237621:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237634:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237640:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237645:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237650:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237655:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237660:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237666:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237672:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237679:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237686:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237692:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237711:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237719:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237726:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237732:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237737:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237776:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.237782:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.238162:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.238167:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.240125:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98e3d0193600:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1787836591.240607:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98e3c567ba00:6698] 2 exiting: rc = 0 00000100:00100000:1.0:1787836591.242205:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98e3d0192200:6696] 0 exiting: rc = 1 00000100:00100000:3.0:1787836591.242464:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242473:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242479:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242486:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242503:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242511:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242517:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242523:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242529:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242534:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242540:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242547:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242553:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242577:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242597:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242603:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242609:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242614:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242621:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242626:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242632:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242638:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242645:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242651:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242657:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242665:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242671:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242677:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242684:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242690:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242705:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242711:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242717:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242723:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242729:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242735:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242741:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242762:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242769:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242774:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242780:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242786:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242792:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242798:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242804:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242810:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242817:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242824:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.242838:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243047:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243075:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243084:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243090:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243096:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243102:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243110:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243116:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243122:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243129:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243134:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243140:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243146:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243151:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.243156:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787836591.255907:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98e3d09a6400:6700] 1 exiting: rc = 0 00000100:00100000:2.0:1787836591.256096:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98e3ce02da00:6699] 0 exiting: rc = 1 00000100:00100000:3.0:1787836591.256178:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256186:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256191:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256196:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256202:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256206:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256212:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256217:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256221:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256226:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256231:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256236:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256240:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256245:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256381:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256389:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256394:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256399:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256403:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256423:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256428:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256433:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256439:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256444:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256449:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256454:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256459:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256464:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256469:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256474:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256479:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256484:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256488:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256493:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256497:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256503:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256507:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256512:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256517:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256522:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256526:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256531:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256536:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256542:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256547:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256552:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256557:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256562:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256566:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256571:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256576:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256642:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256648:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256653:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256665:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256671:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256675:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256680:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256686:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256691:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256737:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256743:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256749:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.256754:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787836591.257603:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98e3c3a2be00:6701] 0 exiting: rc = 1 00000100:00100000:1.0:1787836591.257774:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98e3d39bb600:6702] 1 exiting: rc = 0 00000100:00100000:3.0:1787836591.257935:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.257951:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.257958:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.257964:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.257969:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.257974:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.257980:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.257986:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258002:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258009:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258026:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258032:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258037:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258042:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258049:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258055:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258205:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258211:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258217:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258222:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258228:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258585:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258609:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258615:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258621:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258635:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258640:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258655:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258661:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258667:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258672:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258677:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258682:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258687:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258713:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258719:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258724:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258729:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258735:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258740:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258745:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258750:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258755:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258760:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258765:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258771:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258787:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258885:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258892:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258898:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258904:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258910:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258916:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258925:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258930:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258936:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258941:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258947:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258967:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258973:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.258986:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.259054:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.259420:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787836591.259427:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787836591.274584:0:13228:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787836608.652300:0:13844:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787836617.791760:0:14306:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787836617.791765:0:14306:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787836617.792312:0:14306:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e3fabd3000 00000020:01000004:3.0:1787836617.792332:0:14306:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787836617.792340:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787836617.792365:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98e2c1801a48) 00000020:00000080:3.0:1787836617.792380:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787836617.810988:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787836617.814525:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787836617.814861:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787836617.815712:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787836617.815788:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1787836617.816159:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787836617.816325:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1787836617.816554:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1787836617.816647:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787836617.817249:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1787836617.818814:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 277: rc = 0 00100000:10000000:2.0:1787836617.819283:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 277: rc = 0 00100000:10000000:2.0:1787836617.819852:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 281: rc = 0 00100000:10000000:2.0:1787836617.820708:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 281: rc = 0 00100000:10000000:2.0:1787836617.821332:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 281: rc = 0 00100000:10000000:2.0:1787836617.821719:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 281: rc = 0 00100000:10000000:2.0:1787836617.822279:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 281: rc = 0 00100000:10000000:2.0:1787836617.822679:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 281: rc = 0 00100000:10000000:2.0:1787836617.823323:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 281: rc = 0 00100000:10000000:2.0:1787836617.823719:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 281: rc = 0 00100000:10000000:2.0:1787836617.824301:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 281: rc = 0 00100000:10000000:2.0:1787836617.824706:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 281: rc = 0 00100000:10000000:2.0:1787836617.825351:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 281: rc = 0 00100000:10000000:2.0:1787836617.825734:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 281: rc = 0 00100000:10000000:2.0:1787836617.826643:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 477: rc = 0 00100000:10000000:2.0:1787836617.827288:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 477: rc = 0 00100000:10000000:2.0:1787836617.827697:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 477: rc = 0 00100000:10000000:2.0:1787836617.828361:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 477: rc = 0 00100000:10000000:2.0:1787836617.828766:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 477: rc = 0 00100000:10000000:2.0:1787836617.829536:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 477: rc = 0 00100000:10000000:2.0:1787836617.829800:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 477: rc = 0 00100000:10000000:2.0:1787836617.830361:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 477: rc = 0 00100000:10000000:2.0:1787836617.830748:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 477: rc = 0 00100000:10000000:2.0:1787836617.831388:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 477: rc = 0 00100000:10000000:2.0:1787836617.831780:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 477: rc = 0 00100000:10000000:2.0:1787836617.832371:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 477: rc = 0 00100000:10000000:2.0:1787836617.832753:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 477: rc = 0 00100000:10000000:2.0:1787836617.833028:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 477: rc = 0 00100000:10000000:3.0:1787836617.833921:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 477: rc = 0 00100000:10000000:3.0:1787836617.834231:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 477: rc = 0 00100000:10000000:3.0:1787836617.834491:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 477: rc = 0 00100000:10000000:3.0:1787836617.834747:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 477: rc = 0 00100000:10000000:3.0:1787836617.834981:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 477: rc = 0 00100000:10000000:3.0:1787836617.835269:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 477: rc = 0 00100000:10000000:3.0:1787836617.835523:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 477: rc = 0 00100000:10000000:3.0:1787836617.835767:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 477: rc = 0 00100000:10000000:3.0:1787836617.836026:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 477: rc = 0 00100000:10000000:3.0:1787836617.836306:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 477: rc = 0 00100000:10000000:3.0:1787836617.837569:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 477: rc = 0 00100000:10000000:3.0:1787836617.837844:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 477: rc = 0 00100000:10000000:3.0:1787836617.838574:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 477: rc = 0 00100000:10000000:3.0:1787836617.838832:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 477: rc = 0 00100000:10000000:3.0:1787836617.839476:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 477: rc = 0 00100000:10000000:3.0:1787836617.839772:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 477: rc = 0 00100000:10000000:3.0:1787836617.840551:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 477: rc = 0 00100000:10000000:3.0:1787836617.840813:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 477: rc = 0 00100000:10000000:3.0:1787836617.841635:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 295: rc = 0 00100000:10000000:3.0:1787836617.842696:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787836617.842979:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 278: rc = 0 00100000:10000000:3.0:1787836617.843517:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787836617.843595:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 278: rc = 0 00100000:10000000:3.0:1787836617.843790:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787836617.843854:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 278: rc = 0 00100000:10000000:3.0:1787836617.844822:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787836617.844954:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 464: rc = 0 00100000:10000000:3.0:1787836617.845343:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787836617.845608:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 464: rc = 0 00100000:10000000:3.0:1787836617.845795:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787836617.845850:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 464: rc = 0 00000020:00000080:3.0:1787836617.846566:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787836617.846574:0:14306:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787836617.846584:0:14306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab847e 00000020:01000004:3.0:1787836617.846591:0:14306:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787836617.846597:0:14306:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787836617.846601:0:14306:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e3fabd3000 from MGS 00000020:01000004:3.0:1787836617.846604:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787836617.846613:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98e2c1800000) 00000020:00000080:3.0:1787836617.846620:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787836617.846664:0:14306:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e3fabd3000 from MGS, refs=2 00080000:01000000:3.0:1787836617.846667:0:14306:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787836617.846671:0:14306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab848c 00000100:00100000:3.0:1787836617.846757:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787836617.846935:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787836617.846941:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787836617.847747:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787836617.847764:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787836617.848663:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836617.848832:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787836617.848838:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787836617.850223:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787836617.850235:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787836617.850812:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787836617.850819:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787836617.851856:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836617.851860:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836617.851862:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836617.852560:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836617.852563:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836617.852565:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836617.854932:0:14306:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787836617.861604:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787836617.871313:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787836617.871334:0:14306:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787836617.871337:0:14306:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787836617.874593:0:14315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787836617.877208:0:14306:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787836617.877321:0:14306:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787836617.878078:0:14306:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787836617.878657:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836617.878823:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787836617.878829:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787836617.880194:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787836617.880205:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787836617.880913:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787836617.880922:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787836617.884466:0:14320:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1787836617.885931:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787836617.885953:0:14306:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.125@tcp' 00000020:01000004:3.0:1787836617.885955:0:14306:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787836617.885984:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.125@tcp (typ=mgc) 00000020:00000080:3.0:1787836617.885997:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.125@tcp (ffff98e2c1804ed8) 00000020:00000080:3.0:1787836617.886025:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787836617.886305:0:14306:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e3c5f0e000@MGC192.168.203.125@tcp: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1787836617.886602:0:14306:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.125@tcp-0 is initialized 00000040:01000000:3.0:1787836617.886609:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787836617.891546:0:14321:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787836617.891648:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.125@tcp (uuid 54169f9e-8f3c-47d1-ba67-76dd190fcd61) 00000020:00000080:2.0:1787836617.891673:0:14306:0:(genops.c:1385:class_connect()) connect: client 54169f9e-8f3c-47d1-ba67-76dd190fcd61, cookie 0x966835ea68ab849a 00000100:00080000:2.0:1787836617.891687:0:14306:0:(import.c:510:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787836617.891694:0:14306:0:(import.c:624:import_select_connection()) MGC192.168.203.125@tcp: import ffff98e3c5f0e000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1787836617.891732:0:14306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3fadd2940 x1874682193208192/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787836617.891793:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3309:1874682193208192:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787836617.891852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787836617.891897:0:14306:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 54169f9e-8f3c-47d1-ba67-76dd190fcd61->MGS 00000020:01000004:2.0:1787836617.891916:0:14306:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787836617.891934:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787836617.891946:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98e3d8281a48) 00000020:00000080:2.0:1787836617.891957:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787836617.895867:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193208192 00000100:00100000:0.0:1787836617.895885:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193208192 00000100:00100000:0.0:1787836617.895969:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836617.895977:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874682193208192:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787836617.896015:0:14317:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 54169f9e-8f3c-47d1-ba67-76dd190fcd61@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:0.0:1787836617.896046:0:14317:0:(genops.c:1385:class_connect()) connect: client 54169f9e-8f3c-47d1-ba67-76dd190fcd61, cookie 0x966835ea68ab84a8 00000100:00080000:0.0:1787836617.896662:0:14317:0:(import.c:65:import_set_state_nolock()) ffff98e3c3946000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787836617.896757:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+5:3309:x1874682193208192:12345-0@lo:250:mount.lustre.0 Request processed in 779us (4903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836617.896767:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836617.896989:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787836617.897000:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.125@tcp: connect to target with instance 0 00000100:00080000:0.0:1787836617.897007:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787836617.897011:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787836617.897014:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3c5f0e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787836617.897017:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787836617.897080:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787836617.897086:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3309:1874682193208192:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787836617.904248:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836617.904456:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787836617.904462:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787836617.905834:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787836617.905843:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787836617.906563:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787836617.906572:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787836617.907312:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836617.907479:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787836617.907485:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787836617.908320:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787836617.908327:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787836617.942912:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836617.943223:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787836617.943231:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787836617.946424:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787836617.946436:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787836617.946980:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836617.947180:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787836617.947185:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787836617.947878:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787836617.947884:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787836617.948400:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836617.948547:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787836617.948551:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787836617.949158:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787836617.949164:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787836617.949945:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836617.950345:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787836617.950351:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787836617.950815:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787836617.950821:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787836617.966695:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787836617.966981:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787836617.966987:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787836617.968709:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787836617.968724:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787836617.973000:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787836617.973019:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787836617.974529:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787836617.974558:0:14306:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787836617.974565:0:14306:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787836617.974708:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787836617.974742:0:14306:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787836617.974746:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787836617.974748:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787836617.974749:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836617.974750:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836617.974751:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836617.974752:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836617.974754:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787836617.974755:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787836617.974757:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836617.974758:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787836617.974761:0:14306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787836617.974763:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787836617.974764:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787836617.974765:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836617.974766:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836617.974767:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836617.974768:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836617.974769:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787836617.974770:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787836617.974770:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836617.974771:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787836617.974798:0:14306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787836617.974816:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787836617.975217:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836617.975291:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1d56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787836617.975424:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193208320 00000100:00100000:0.0:1787836617.975437:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193208320 00000100:00100000:0.0:1787836617.975497:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787836617.975515:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+5:14306:x1874682193208320:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787836617.975559:0:14319:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787836617.975562:0:14319:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787836617.975565:0:14319:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787836617.975822:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787836617.976254:0:14319:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787836617.977759:0:14340:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787836617.977766:0:14340:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787836617.977768:0:14340:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787836617.977802:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787836617.978114:0:14319:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787836617.978125:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787836617.983401:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+5:14306:x1874682193208320:12345-0@lo:253:mount.lustre.0 Request processed in 7887us (8176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836617.983422:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787836617.983531:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787836617.983547:0:14306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787836617.983550:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787836617.983552:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787836617.983553:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836617.983566:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836617.983567:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836617.983568:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836617.983569:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787836617.983570:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787836617.983572:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836617.983574:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787836617.983603:0:14306:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e3fabd3000 from lustre-MDT0000 10000000:01000000:2.0:1787836617.983627:0:14306:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787836617.983630:0:14306:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787836617.983634:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98e2c1804ed8 10000000:01000000:2.0:1787836617.983638:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787836617.983644:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98e2c1804ed8 from 1 10000000:01000000:2.0:1787836617.983648:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787836617.983681:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836617.983691:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836617.983700:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836617.983717:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787836617.983752:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836617.983787:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651600 going to sleep for 11 seconds 00000100:00100000:0.0:1787836617.983839:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193208448 00000100:00100000:0.0:1787836617.983845:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193208448 00000100:00100000:0.0:1787836617.983997:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787836617.984007:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+5:14306:x1874682193208448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787836617.984019:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836617.984032:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e401d3fc00/0x966835ea68ab84b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab84af expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836617.984090:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e401d3fc00/0x966835ea68ab84b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab84af expref: 6 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836617.984102:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e401d3fc00/0x966835ea68ab84b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab84af expref: 6 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836617.984111:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3fc00, rc 0) 00000100:00100000:0.0:1787836617.984148:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+6:14306:x1874682193208448:12345-0@lo:101:mount.lustre.0 Request processed in 143us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836617.984154:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836617.984222:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787836617.984235:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.984256:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836617.984301:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787836617.984328:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836617.984637:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193208576 00000100:00100000:2.0:1787836617.984642:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193208576 00000100:00100000:2.0:1787836617.984661:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836617.984668:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+6:14306:x1874682193208576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836617.984934:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+6:14306:x1874682193208576:12345-0@lo:501:mount.lustre.0 Request processed in 196us (535us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787836617.984953:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836617.985044:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99180 going to sleep for 11 seconds 00000100:00100000:1.0:1787836617.985203:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208576:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787836617.985228:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787836617.985298:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.985307:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836617.985314:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e3fabd3000 10000000:01000000:1.0:1787836617.985319:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787836617.985323:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98e3fabd3000 10000000:01000000:1.0:1787836617.985326:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787836617.985328:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98e3fabd3000 from 1 10000000:01000000:1.0:1787836617.985331:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787836617.985351:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5600/0x966835ea68ab84bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.985358:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5600/0x966835ea68ab84bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.985365:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5600/0x966835ea68ab84bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836617.985385:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787836617.985411:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836617.985436:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836617.985559:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193208704 00000100:00100000:2.0:1787836617.985564:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193208704 00000100:00100000:2.0:1787836617.985621:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787836617.985637:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+6:14306:x1874682193208704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787836617.985645:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836617.985656:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a600/0x966835ea68ab84c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab84bd expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836617.985673:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a600/0x966835ea68ab84c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab84bd expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836617.985682:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a600/0x966835ea68ab84c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab84bd expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836617.985689:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a600, rc 0) 00000100:00100000:2.0:1787836617.985725:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+7:14306:x1874682193208704:12345-0@lo:101:mount.lustre.0 Request processed in 97us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836617.985731:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836617.985784:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787836617.985794:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5600/0x966835ea68ab84bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84c4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.985801:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5600/0x966835ea68ab84bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab84c4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836617.985813:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787836617.986219:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5600/0x966835ea68ab84bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84c4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.986227:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f5600/0x966835ea68ab84bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84c4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836617.986233:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787836617.986238:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787836617.986242:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98e3fabd3000 10000000:01000000:1.0:1787836617.986245:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787836617.986248:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787836617.986250:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787836617.986265:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4800/0x966835ea68ab84cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.986272:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4800/0x966835ea68ab84cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.986287:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4800/0x966835ea68ab84cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836617.986300:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787836617.986327:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836617.986389:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836617.986534:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193208832 00000100:00100000:2.0:1787836617.986539:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193208832 00000100:00100000:2.0:1787836617.986572:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787836617.986580:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+7:14306:x1874682193208832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787836617.986587:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836617.986596:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005ac00/0x966835ea68ab84d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab84cb expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836617.986611:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005ac00/0x966835ea68ab84d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab84cb expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836617.986627:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005ac00/0x966835ea68ab84d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab84cb expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836617.986635:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005ac00, rc 0) 00000100:00100000:2.0:1787836617.986672:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+8:14306:x1874682193208832:12345-0@lo:101:mount.lustre.0 Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836617.986678:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836617.986776:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787836617.986789:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4800/0x966835ea68ab84cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84d2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836617.986796:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4800/0x966835ea68ab84cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab84d2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836617.986843:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787836617.986938:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836617.986960:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836617.987005:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193208960 00000100:00100000:2.0:1787836617.987010:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193208960 00000100:00100000:2.0:1787836617.987039:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787836617.987045:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+8:14306:x1874682193208960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836617.987562:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+9:14306:x1874682193208960:12345-0@lo:501:mount.lustre.0 Request processed in 517us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836617.987569:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787836617.987664:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193208960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787836617.987694:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193209088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787836617.987733:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836617.987759:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99180 going to sleep for 11 seconds 00000100:00100000:3.0:1787836617.987812:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193209088 00000100:00100000:3.0:1787836617.987816:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193209088 00000100:00100000:3.0:1787836617.987846:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787836617.987853:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+9:14306:x1874682193209088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836617.988340:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+9:14306:x1874682193209088:12345-0@lo:503:mount.lustre.0 Request processed in 487us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836617.988347:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787836617.988436:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193209088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787836617.989003:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14341:1874682193209216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836617.989046:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836617.989341:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787836617.989384:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193209216 00000100:00100000:3.0:1787836617.989389:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193209216 00000100:00100000:3.0:1787836617.989457:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787836617.989464:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+9:14341:x1874682193209216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836617.989742:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+9:14341:x1874682193209216:12345-0@lo:502:llog_process_th.0 Request processed in 278us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836617.989749:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787836617.989818:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14341:1874682193209216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787836617.989842:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836617.989853:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836617.989855:0:14341:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787836617.989860:0:14341:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787836617.989873:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787836617.989888:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98e3f5804ed8) 00000020:00000080:1.0:1787836617.989906:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787836617.989911:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787836617.989976:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787836617.989982:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab84e0 00000020:00000080:1.0:1787836617.990203:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787836617.990207:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836617.990210:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836617.990211:0:14341:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787836617.990214:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836617.990217:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836617.990218:0:14341:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787836617.990221:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787836617.990228:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98e3f5803490) 00000020:00000080:1.0:1787836617.990237:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787836617.990241:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787836617.990243:0:14341:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787836617.990245:0:14341:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787836617.990251:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787836617.990294:0:14341:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e3fabd3000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787836617.990305:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98e3f5801a48) 00000020:00000080:1.0:1787836617.990312:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787836617.990354:0:14341:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787836617.990360:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab84f5 00000020:00000080:1.0:1787836617.990444:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787836617.990451:0:14341:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787836617.990460:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x966835ea68ab84fc 00080000:01000000:1.0:1787836617.990464:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787836617.990467:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab8503 00010000:00010000:2.0:1787836618.087591:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787836618.088853:0:14341:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787836618.089387:0:14341:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787836618.090052:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98e3d8280000) 00000020:00000080:2.0:1787836618.090090:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787836618.090165:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787836618.090170:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab8511 00000020:00000080:3.0:1787836618.096739:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787836618.106167:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x966835ea68ab8518 00000020:00000080:2.0:1787836618.107119:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787836618.107134:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836618.107142:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836618.107145:0:14341:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787836618.107148:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787836618.107155:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836618.107167:0:14341:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787836618.107172:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787836618.107222:0:14341:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787836618.107241:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787836618.107245:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836618.107246:0:14341:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787836618.107249:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787836618.107251:0:14341:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787836618.107253:0:14341:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787836618.107254:0:14341:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787836618.107255:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787836618.107258:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836618.107259:0:14341:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787836618.107261:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787836618.107264:0:14341:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787836618.107267:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836618.107269:0:14341:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787836618.107273:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787836618.107279:0:14341:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:2.0:1787836618.107318:0:14341:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787836618.107321:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787836618.107342:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98e3d8284ed8) 00000020:00000080:2.0:1787836618.107359:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787836618.107363:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787836618.107421:0:14341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787836618.107427:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787836618.107435:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab8526 00010000:00080000:2.0:1787836618.107477:0:14341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e3ef7e1800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1787836618.107762:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787836618.109618:0:14341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787836618.109676:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787836618.117617:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787836618.117711:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787836618.117799:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787836618.118830:0:14345:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787836618.118836:0:14345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787836618.119801:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787836618.119813:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787836618.119844:0:14341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787836618.119873:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab852d 00000100:00080000:1.0:1787836618.119883:0:14341:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787836618.119889:0:14341:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98e3ef7e1800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1787836618.119921:0:14341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c2649a40 x1874682193209344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787836618.119948:0:14341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787836618.120001:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836618.120005:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836618.120007:0:14341:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787836618.120010:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787836618.120012:0:14341:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787836618.120014:0:14341:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787836618.120016:0:14341:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787836618.120017:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787836618.120019:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836618.120020:0:14341:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787836618.120023:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787836618.120026:0:14341:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787836618.120029:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836618.120030:0:14341:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787836618.120033:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787836618.120037:0:14341:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000100:00100000:3.0:1787836618.120281:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193209344:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787836618.120340:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874682193209344 offset 0 length 520: 4 00000020:01000000:1.0:1787836618.120485:0:14341:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787836618.120489:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787836618.120502:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98e3f5800000) 00000020:00000080:1.0:1787836618.120526:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787836618.120541:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787836618.120603:0:14341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787836618.120610:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787836618.120616:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x966835ea68ab853b 00010000:00080000:1.0:1787836618.120650:0:14341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e3ef7fd000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1787836618.120961:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787836618.125930:0:14341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787836618.125979:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787836618.126795:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787836618.126860:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787836618.129007:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787836618.130261:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787836618.130269:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787836618.131380:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787836618.131393:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787836618.131427:0:14341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787836618.131445:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab8542 00000100:00080000:1.0:1787836618.131456:0:14341:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787836618.131462:0:14341:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e3ef7fd000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1787836618.131498:0:14341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c26492c0 x1874682193209472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787836618.132344:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c26492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193209472:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787836618.132427:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874682193209472 offset 0 length 520: 4 00000100:00080000:1.0:1787836618.132491:0:14341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787836618.132567:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836618.132573:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836618.132575:0:14341:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787836618.132578:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836618.132582:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836618.132583:0:14341:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787836618.132586:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787836618.132588:0:14341:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787836618.132591:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836618.132593:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836618.132595:0:14341:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787836618.132613:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836618.132615:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836618.132617:0:14341:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787836618.132620:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787836618.132667:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14341:1874682193209600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836618.132724:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836618.132744:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836618.132990:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193209600 00000100:00100000:0.0:1787836618.132998:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193209600 00000100:00100000:0.0:1787836618.133040:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787836618.133082:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+9:14341:x1874682193209600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787836618.133345:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+9:14341:x1874682193209600:12345-0@lo:502:llog_process_th.0 Request processed in 296us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836618.133353:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787836618.133529:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14341:1874682193209600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787836618.133557:0:14341:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836618.133562:0:14341:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836618.133564:0:14341:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787836618.133568:0:14341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787836618.134156:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787836618.134179:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787836618.134207:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4800/0x966835ea68ab84cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84d2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.134218:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3ce1f4800/0x966835ea68ab84cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84d2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836618.134244:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e3fabd3000 from 1 10000000:01000000:0.0:1787836618.134247:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787836618.134290:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.134297:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.134308:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836618.134328:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193209728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787836618.134374:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836618.134421:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c6089e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787836618.134556:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193209728 00000100:00100000:1.0:1787836618.134564:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193209728 00000100:00100000:1.0:1787836618.134602:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787836618.134612:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+9:14306:x1874682193209728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787836618.134622:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836618.134638:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab8549 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.134673:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab8549 expref: 10 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.134686:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8549 expref: 10 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.134695:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5200, rc 0) 00000100:00100000:1.0:1787836618.134729:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+10:14306:x1874682193209728:12345-0@lo:101:mount.lustre.0 Request processed in 119us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836618.134745:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787836618.135445:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193209728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787836618.135465:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.135475:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836618.136232:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193209856:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787836618.136302:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836618.136357:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c6089e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787836618.136385:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193209856 00000100:00100000:0.0:1787836618.136492:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193209856 00000100:00100000:0.0:1787836618.136596:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787836618.136652:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+10:14306:x1874682193209856:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787836618.136674:0:14319:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787836618.136680:0:14319:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787836618.136749:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+10:14306:x1874682193209856:12345-0@lo:256:mount.lustre.0 Request processed in 100us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836618.136757:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787836618.138448:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193209856:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787836618.139285:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787836618.139315:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836618.139343:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836618.139352:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3fabd3000 from 1 10000000:01000000:3.0:1787836618.139355:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787836618.139530:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836618.139538:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836618.139547:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836618.139569:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193209984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787836618.139636:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.140723:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4e04cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836618.141082:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193209984 00000100:00100000:1.0:1787836618.141094:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193209984 00000100:00100000:1.0:1787836618.141151:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787836618.141160:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+10:14306:x1874682193209984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787836618.141179:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836618.141202:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab8557 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.141235:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab8557 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.141248:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8557 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.141258:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4a00, rc 0) 00000100:00100000:1.0:1787836618.141332:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14306:x1874682193209984:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836618.141339:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787836618.141629:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193209984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787836618.141646:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836618.141654:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836618.141717:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787836618.141753:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.141785:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4e04cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836618.141984:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193210112 00000100:00100000:1.0:1787836618.141989:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193210112 00000100:00100000:1.0:1787836618.142008:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836618.142013:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14306:x1874682193210112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787836618.145639:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14306:x1874682193210112:12345-0@lo:501:mount.lustre.0 Request processed in 3612us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836618.145657:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787836618.145824:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787836618.145903:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836618.145964:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.146002:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4e04cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836618.146209:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193210240 00000100:00100000:1.0:1787836618.146222:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193210240 00000100:00100000:1.0:1787836618.146258:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787836618.146265:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14306:x1874682193210240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787836618.146465:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14306:x1874682193210240:12345-0@lo:503:mount.lustre.0 Request processed in 200us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836618.146472:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787836618.146656:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836618.147770:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14349:1874682193210368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836618.147829:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.147970:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4e04240 going to sleep for 11 seconds 00000100:00100000:1.0:1787836618.148008:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193210368 00000100:00100000:1.0:1787836618.148014:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193210368 00000100:00100000:1.0:1787836618.148295:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787836618.148305:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14349:x1874682193210368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836618.148694:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14349:x1874682193210368:12345-0@lo:502:llog_process_th.0 Request processed in 389us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836618.148701:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787836618.148784:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14349:1874682193210368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787836618.148808:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836618.148816:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836618.148818:0:14349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787836618.148824:0:14349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e3fabd3000 00000020:00000080:3.0:1787836618.148827:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787836618.148834:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836618.148836:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836618.148838:0:14349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787836618.148840:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836618.148842:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836618.148843:0:14349:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787836618.148846:0:14349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e3fabd3000 00000020:00000080:3.0:1787836618.148848:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787836618.148963:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836618.148966:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836618.148967:0:14349:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787836618.148969:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836618.148972:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836618.148973:0:14349:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787836618.148976:0:14349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e3fabd3000 00000020:00000080:3.0:1787836618.148984:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787836618.149018:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14349:1874682193210496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836618.149077:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.149102:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4e04240 going to sleep for 11 seconds 00000100:00100000:2.0:1787836618.149202:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193210496 00000100:00100000:2.0:1787836618.149207:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193210496 00000100:00100000:2.0:1787836618.149240:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787836618.149247:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14349:x1874682193210496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836618.149366:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14349:x1874682193210496:12345-0@lo:502:llog_process_th.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836618.149373:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787836618.149517:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14349:1874682193210496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787836618.149534:0:14349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836618.149539:0:14349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836618.149541:0:14349:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787836618.149544:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787836618.149711:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787836618.149730:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787836618.149748:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836618.149759:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836618.149799:0:14306:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787836618.149801:0:14306:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e3fabd3000 10000000:01000000:2.0:1787836618.149804:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e3fabd3000 10000000:01000000:2.0:1787836618.149808:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787836618.149813:0:14306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3fabd3000 from 1 10000000:01000000:2.0:1787836618.149815:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787836618.149841:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab8565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836618.149860:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab8565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836618.149935:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab8565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836618.149949:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787836618.149978:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836618.149999:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651600 going to sleep for 11 seconds 00000100:00100000:2.0:1787836618.150011:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193210624 00000100:00100000:2.0:1787836618.150015:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193210624 00000100:00100000:2.0:1787836618.150036:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836618.150041:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14306:x1874682193210624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787836618.150134:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836618.150145:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005ae00/0x966835ea68ab856c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab8565 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836618.150164:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005ae00/0x966835ea68ab856c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab8565 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836618.150174:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005ae00/0x966835ea68ab856c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8565 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836618.150183:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005ae00, rc 0) 00000100:00100000:2.0:1787836618.150209:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14306:x1874682193210624:12345-0@lo:101:mount.lustre.0 Request processed in 167us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836618.150215:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836618.150252:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787836618.150264:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab8565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab856c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836618.150273:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab8565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab856c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836618.150310:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836618.150330:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836618.150341:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1d56540 going to sleep for 11 seconds 00000100:00100000:2.0:1787836618.150351:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193210752 00000100:00100000:2.0:1787836618.150354:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193210752 00000100:00100000:2.0:1787836618.150367:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787836618.150372:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14306:x1874682193210752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836618.151663:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14306:x1874682193210752:12345-0@lo:501:mount.lustre.0 Request processed in 1284us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836618.151674:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787836618.151755:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836618.151794:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787836618.151834:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836618.151860:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1d56540 going to sleep for 11 seconds 00000100:00100000:3.0:1787836618.151982:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193210880 00000100:00100000:3.0:1787836618.151988:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193210880 00000100:00100000:3.0:1787836618.152013:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787836618.152020:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14306:x1874682193210880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836618.152177:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14306:x1874682193210880:12345-0@lo:503:mount.lustre.0 Request processed in 157us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836618.152184:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787836618.152690:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193210880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836618.168369:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14350:1874682193211008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836618.168548:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.168601:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4e04d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787836618.168674:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193211008 00000100:00100000:2.0:1787836618.168681:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193211008 00000100:00100000:2.0:1787836618.168730:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787836618.168740:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14350:x1874682193211008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787836618.170676:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14350:x1874682193211008:12345-0@lo:502:llog_process_th.0 Request processed in 1918us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836618.170689:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787836618.178611:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14350:1874682193211008:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787836618.179694:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787836618.179711:0:14350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98e2c1803490) 00000020:00000080:3.0:1787836618.179729:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787836618.179828:0:14350:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e3fabd3000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787836618.179832:0:14350:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e3fabd3000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787836618.179834:0:14350:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e3fabd3000 4 00010000:00080000:3.0:1787836618.179877:0:14350:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e3c7f97000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1787836618.181433:0:14350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787836618.181641:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787836618.181675:0:14350:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787836618.181689:0:14350:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x966835ea68ab857a 00000100:00080000:3.0:1787836618.181701:0:14350:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787836618.181708:0:14350:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98e3c7f97000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1787836618.181750:0:14350:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c378ad00 x1874682193211136/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787836618.181800:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193211136:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787836618.181871:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.181938:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193211136 00000100:00100000:3.0:1787836618.181944:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193211136 00000100:00100000:3.0:1787836618.181971:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787836618.181977:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c3789e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874682193211136:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787836618.182026:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c3789e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874682193211136:12345-0@lo:38:llog_process_th.0 Request processed in 47us (154us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787836618.182032:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787836618.182088:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787836618.182095:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3c7f97000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787836618.182110:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787836618.182114:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193211136:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787836618.182144:0:14350:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787836618.189847:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14350:1874682193211264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787836618.189955:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.190001:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4e04d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836618.192055:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193211264 00000100:00100000:1.0:1787836618.192094:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193211264 00000100:00100000:1.0:1787836618.192151:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787836618.192160:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14350:x1874682193211264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787836618.192585:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14350:x1874682193211264:12345-0@lo:502:llog_process_th.0 Request processed in 424us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836618.192594:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787836618.194043:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14350:1874682193211264:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787836618.194126:0:14350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787836618.194211:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787836618.194231:0:14306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787836618.194248:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab8565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab856c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836618.194259:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b200/0x966835ea68ab8565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab856c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787836618.194303:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787836618.194306:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787836618.194307:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836618.194308:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836618.194310:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836618.194311:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836618.194312:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787836618.194314:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787836618.194315:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836618.194316:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787836618.194320:0:14306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787836618.194322:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787836618.194324:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787836618.194325:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836618.194326:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836618.194327:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836618.194328:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836618.194328:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787836618.194329:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787836618.194330:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836618.194331:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787836618.194363:0:14306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787836618.194379:0:14306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193211392:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787836618.194972:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836618.200634:0:14306:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4e04d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836618.201547:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193211392 00000100:00100000:1.0:1787836618.201558:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193211392 00000100:00100000:1.0:1787836618.201615:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787836618.201625:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14306:x1874682193211392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787836618.201678:0:14319:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787836618.201697:0:14319:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787836618.281459:0:14319:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787836618.281476:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787836618.281731:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787836618.281749:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787836618.281771:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.281789:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8549 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.281798:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.281835:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab8549 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836618.281849:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab8549 expref: 12 pid: 14317 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836618.281863:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1874682193211520:0@lo:104: 00000100:00100000:1.0:1787836618.281926:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836618.281980:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1912240 going to sleep for 11 seconds 00000100:00100000:0.0:1787836618.282117:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193211520 00000100:00100000:0.0:1787836618.282125:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193211520 00000100:00100000:0.0:1787836618.282165:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836618.282174:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:14339:x1874682193211520:12345-0@lo:104: 00010000:00010000:0.0:1787836618.282185:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282236:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836618.282242:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:14339:x1874682193211520:12345-0@lo:104: Request processed in 70us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836618.282249:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787836618.282273:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836618.282279:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282287:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ea00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836618.282290:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282299:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836618.282318:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836618.282323:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787836618.282373:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282380:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836618.282399:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282406:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab8550 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282420:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836618.282422:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836618.282424:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836618.282453:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193211648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787836618.282482:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836618.282546:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193211648 00000100:00100000:0.0:1787836618.282551:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193211648 00010000:00010000:0.0:1787836618.282566:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8549 expref: 13 pid: 14317 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836618.282596:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787836618.282603:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+13:3312:x1874682193211648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787836618.282626:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836618.282632:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8549 expref: 13 pid: 14317 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282647:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab8549 expref: 13 pid: 14317 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282663:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282671:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787836618.282683:0:14309:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000934630s 00010000:00010000:0.0:1787836618.282687:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282694:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282702:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282708:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282713:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836618.282717:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282724:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282732:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282747:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836618.282784:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+13:3312:x1874682193211648:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836618.282790:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787836618.282822:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab8550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab8549 expref: 12 pid: 14317 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836618.282832:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1874682193211520:0@lo:104: 00010000:00010000:0.0:1787836618.282849:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282857:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836618.282863:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836618.282869:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193211648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787836618.282869:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab8581 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836618.310365:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14306:x1874682193211392:12345-0@lo:253:mount.lustre.0 Request processed in 108731us (115382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836618.310380:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787836618.310568:0:14306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14306:1874682193211392:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787836618.310601:0:14306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787836618.310605:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787836618.310606:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787836618.310608:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836618.310609:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836618.310610:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836618.310611:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836618.310612:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787836618.310614:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787836618.310616:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836618.310896:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787836618.310915:0:14306:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787836618.316414:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787836618.316596:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787836618.317212:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787836618.317378:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787836618.318431:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787836618.318854:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836618.320264:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836618.320460:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836618.320985:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836618.321249:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787836618.321533:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787836618.321833:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787836618.365214:0:14306:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787836618.365748:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787836618.366260:0:14361:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787836618.366265:0:14361:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787836618.366688:0:14362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787836618.366791:0:14362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787836618.370000:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787836618.370215:0:14362:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787836618.370220:0:14362:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787836618.378749:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787836618.379347:0:14306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787836618.379831:0:14306:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787836618.379842:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787836618.380185:0:14306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787836618.381683:0:14306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787836618.382646:0:14306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787836618.382786:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787836618.384026:0:14306:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1787836618.387813:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787836618.398714:0:14306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787836618.431662:0:14306:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787836618.431701:0:14306:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0bac1c6f988 00100000:10000000:0.0:1787836618.431710:0:14306:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787836618.432760:0:14306:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787836618.432774:0:14306:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787836618.432791:0:14306:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787836618.432806:0:14306:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787836618.862632:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787836619.246495:0:14357:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787836619.246520:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787836619.246915:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1787836619.246922:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1787836619.566741:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787836619.566748:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e3fabd3000 from 6 10000000:01000000:0.0:1787836619.566753:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787836619.566804:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836619.566816:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836619.566828:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836619.566915:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193211776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787836619.566991:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836619.567093:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583180 going to sleep for 11 seconds 00000100:00100000:1.0:1787836619.567194:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193211776 00000100:00100000:1.0:1787836619.567201:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193211776 00000100:00100000:1.0:1787836619.567251:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787836619.567260:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14321:x1874682193211776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787836619.567286:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836619.567299:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab8588 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836619.567322:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab8588 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836619.567332:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8588 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836619.567341:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5e00, rc 0) 00000100:00100000:1.0:1787836619.567377:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14321:x1874682193211776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836619.567383:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787836619.567641:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193211776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836619.567655:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836619.567663:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836619.567719:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193211904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787836619.567748:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836619.567773:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d8583180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836619.567843:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193211904 00000100:00100000:2.0:1787836619.567847:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193211904 00000100:00100000:2.0:1787836619.567888:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787836619.567894:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14321:x1874682193211904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787836619.567905:0:14317:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787836619.567921:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787836619.567924:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787836619.568002:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14321:x1874682193211904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836619.568010:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787836619.568470:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193211904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787836619.568534:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787836619.568541:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836619.568550:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836619.886183:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787836620.286841:0:14357:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787836620.286857:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787836620.287802:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787836620.287878:0:14357:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787836620.287912:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1787836620.912541:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836621.935674:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836622.960411:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836623.251587:0:14605:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787836623.599797:0:1360:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787836623.599805:0:1360:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787836623.599808:0:1360:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787836623.599811:0:1360:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787836623.599813:0:1360:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787836623.599816:0:1360:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787836623.599820:0:1360:0:(import.c:65:import_set_state_nolock()) ffff98e3c7f97000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787836623.599833:0:1360:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98e3c7f97000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1787836623.599854:0:1360:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3fadd0780 x1874682193212160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787836623.599884:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787836623.599899:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193212032:0@lo:400:kworker.0 00000100:00100000:2.0:1787836623.600008:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836623.600142:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193212160:0@lo:38:kworker.0 00000100:00100000:2.0:1787836623.600185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836623.600254:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193212032 00000100:00100000:2.0:1787836623.600262:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193212032 00000100:00100000:2.0:1787836623.600320:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787836623.600330:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:3312:x1874682193212032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836623.600385:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:3312:x1874682193212032:12345-0@lo:400:kworker.0 Request processed in 56us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836623.600393:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787836623.600458:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193212032:0@lo:400:kworker.0 00000100:00100000:1.0:1787836623.601365:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193212160 00000100:00100000:1.0:1787836623.601389:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193212160 00000100:00100000:1.0:1787836623.602094:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787836623.602105:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874682193212160:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787836623.602138:0:14325:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1787836623.602177:0:14325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x966835ea68ab8596 00000004:00100000:1.0:1787836623.602195:0:14325:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787836623.602354:0:14325:0:(import.c:65:import_set_state_nolock()) ffff98e3f7ae7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836623.603686:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874682193212160:12345-0@lo:38:kworker.0 Request processed in 1574us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836623.603700:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787836623.603817:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e3fadd0780 x1874682193212160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787836633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787836623.603844:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787836623.603852:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787836623.603857:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787836623.603860:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3c7f97000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787836623.603866:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874682193212160:0@lo:38:kworker.0 00010000:00010000:1.0:1787836623.982291:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836625.015440:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836626.035885:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787836626.562418:0:14755:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef94e1fd0 20000000:00000080:2.0:1787836626.562443:0:14755:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e3f6c9f800 uarg=0000000000000000 20000000:01000000:2.0:1787836626.562488:0:14755:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787836626.562495:0:14755:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787836626.562501:0:14755:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787836626.563415:0:14756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787836626.563579:0:14755:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787836626.569280:0:14755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787836626.569326:0:14755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836626.569350:0:14755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8557 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836626.569361:0:14755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836626.569422:0:14755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab8557 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836626.569442:0:14755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab8557 expref: 11 pid: 14317 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836626.569470:0:14755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14755:1874682193212288:0@lo:104: 00000100:00100000:1.0:1787836626.569545:0:14755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836626.569613:0:14755:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e951c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787836626.569807:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193212288 00000100:00100000:0.0:1787836626.569815:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193212288 00000100:00100000:0.0:1787836626.569865:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787836626.569873:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2649680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:14755:x1874682193212288:12345-0@lo:104: 00010000:00010000:0.0:1787836626.569886:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836626.569944:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836626.569950:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2649680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:14755:x1874682193212288:12345-0@lo:104: Request processed in 78us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836626.569964:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787836626.570249:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836626.570257:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570264:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac600 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:3.0:1787836626.570269:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570276:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787836626.570293:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836626.570299:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787836626.570339:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570345:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787836626.570373:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570381:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab8557 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab855e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570400:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836626.570402:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836626.570403:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836626.570467:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787836626.570479:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3789a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3311:1874682193212416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787836626.570524:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836626.570708:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193212416 00000100:00100000:3.0:1787836626.570712:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193212416 00010000:00010000:3.0:1787836626.570733:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8557 expref: 12 pid: 14317 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836626.570768:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836626.570775:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:3311:x1874682193212416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787836626.570784:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836626.570788:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8557 expref: 12 pid: 14317 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570798:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab8557 expref: 12 pid: 14317 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570820:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570828:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570841:0:14310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570848:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570854:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570859:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570864:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4c00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836626.570868:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570875:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570882:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836626.570891:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836626.570925:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:3311:x1874682193212416:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836626.570941:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787836626.571027:0:14755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab855e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab8557 expref: 11 pid: 14317 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836626.571037:0:14755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14755:1874682193212288:0@lo:104: 00010000:00010000:1.0:1787836626.571081:0:14755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836626.571091:0:14755:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836626.571098:0:14755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836626.571104:0:14755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f4c00/0x966835ea68ab859d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836626.571709:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3789a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3311:1874682193212416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787836627.054416:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787836628.015652:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787836628.015660:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3fabd3000 from 10 10000000:01000000:0.0:1787836628.015667:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787836628.015719:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836628.015731:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836628.015745:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836628.015775:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193212544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787836628.015857:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836628.015932:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ecec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787836628.017762:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193212544 00000100:00100000:1.0:1787836628.017776:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193212544 00000100:00100000:1.0:1787836628.017846:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787836628.017856:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+11:14321:x1874682193212544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787836628.017873:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836628.017904:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab85a4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836628.017933:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836628.017944:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836628.017953:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4a00, rc 0) 00000100:00100000:1.0:1787836628.018338:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14321:x1874682193212544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 482us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836628.018345:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787836628.018460:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193212544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836628.018479:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836628.018489:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836628.018557:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193212672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836628.018591:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836628.018615:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c8ecec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836628.018667:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193212672 00000100:00100000:2.0:1787836628.018672:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193212672 00000100:00100000:2.0:1787836628.018712:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787836628.018720:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14321:x1874682193212672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836628.018992:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14321:x1874682193212672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836628.018999:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787836628.019165:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193212672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836628.019200:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c37892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193212800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836628.019240:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836628.019258:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3f5ed8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787836628.019278:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193212800 00000100:00100000:1.0:1787836628.019284:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193212800 00000100:00100000:1.0:1787836628.019305:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787836628.019311:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14321:x1874682193212800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787836628.019468:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:14321:x1874682193212800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836628.019475:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787836628.019581:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c37892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193212800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787836628.023471:0:14817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787836628.028271:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787836628.028321:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787836628.028362:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836628.029218:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836628.079228:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836628.719405:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787836618/real 1787836618] req@ffff98e2c26492c0 x1874682193209472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787836628 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836628.719451:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e2c26492c0 x1874682193209472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787836628 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836628.719461:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787836618/real 1787836618] req@ffff98e2c2649a40 x1874682193209344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787836628 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836628.719473:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e2c2649a40 x1874682193209344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787836628 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787836628.719494:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787836628.719521:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787836628.719525:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c26492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193209472:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787836628.719532:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7e1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787836628.719537:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787836628.719539:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193209344:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787836628.719680:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787836628.719685:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787836628.719687:0:8:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7e1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787836628.719692:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1787836628.719698:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787836628.719704:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98e3ef7e1800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1787836628.719726:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c378a940 x1874682193213056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787836628.719739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787836628.719742:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787836628.719743:0:8:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787836628.719746:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1787836628.719748:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787836628.719758:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e3ef7fd000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1787836628.719771:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c3789680 x1874682193213184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787836628.720118:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c37892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3311:1874682193212928:0@lo:400:kworker.0 00000100:00100000:1.0:1787836628.720228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836628.720360:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193213312:0@lo:400:kworker.0 00000100:00100000:3.0:1787836628.720399:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836628.723262:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193213056:0@lo:8:kworker.0 00000400:00000100:2.0:1787836628.723325:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874682193213056 offset 0 length 520: 4 00000100:00100000:1.0:1787836628.726000:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193212928 00000100:00100000:1.0:1787836628.726017:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193212928 00000100:00100000:1.0:1787836628.726101:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787836628.726112:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:3311:x1874682193212928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836628.726816:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:3311:x1874682193212928:12345-0@lo:400:kworker.0 Request processed in 704us (6586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836628.726941:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787836628.727387:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193213312 00000100:00100000:3.0:1787836628.727395:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193213312 00000100:00100000:3.0:1787836628.727424:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787836628.727442:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c37883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193213312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836628.727486:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c37883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193213312:12345-0@lo:400:kworker.0 Request processed in 56us (7087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836628.727492:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787836628.727536:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98e2c378a1c0 x1874682193213312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836628.727553:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193213312:0@lo:400:kworker.0 00000100:00100000:0.0:1787836628.729305:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c37892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3311:1874682193212928:0@lo:400:kworker.0 00000100:00100000:2.0:1787836628.736331:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3789680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193213184:0@lo:8:kworker.0 00000400:00000100:2.0:1787836628.736409:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874682193213184 offset 0 length 520: 4 00010000:00010000:3.0:1787836629.102236:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836630.126214:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787836630.510738:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787836631.160704:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787836631.935187:0:15005:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787836631.935192:0:15005:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787836631.935305:0:15005:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e3c833e000 00000020:01000004:2.0:1787836631.935324:0:15005:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787836631.935338:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787836631.935353:0:15005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98e3d8283490) 00000020:00000080:2.0:1787836631.935377:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787836631.960288:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787836631.960704:0:15005:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787836631.962684:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787836631.962920:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787836631.965048:0:15005:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787836631.966012:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 107: rc = 0 00100000:10000000:3.0:1787836631.966169:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 107: rc = 0 00100000:10000000:3.0:1787836631.966268:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 107: rc = 0 00100000:10000000:3.0:1787836631.966710:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:3.0:1787836631.967013:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1787836631.967325:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1787836631.968001:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:3.0:1787836631.968863:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1787836631.969352:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00000020:00000080:3.0:1787836631.973920:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787836631.973941:0:15005:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787836631.973960:0:15005:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x966835ea68ab85b9 00000020:01000004:3.0:1787836631.973981:0:15005:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787836631.974008:0:15005:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787836631.974013:0:15005:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787836631.974020:0:15005:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787836631.974026:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787836631.974049:0:15005:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98e3ef910000) 00000020:00000080:3.0:1787836631.974103:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787836631.977810:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836631.978492:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787836631.978499:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787836631.979277:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787836631.979285:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787836631.990716:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787836631.990741:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787836631.993937:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787836631.994255:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787836631.994262:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787836631.994778:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787836631.994785:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787836632.009001:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787836632.009338:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787836632.009344:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787836632.020048:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787836632.020083:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787836632.021495:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787836632.021511:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787836632.023851:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787836632.024404:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787836632.024421:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787836632.025048:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787836632.025195:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787836632.075654:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787836632.076031:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787836632.076042:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787836632.078034:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787836632.078051:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787836632.079286:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787836632.079311:0:15005:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787836632.079317:0:15005:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787836632.095334:0:15005:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787836632.095638:0:15005:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787836632.095643:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787836632.095644:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787836632.095646:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836632.095647:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787836632.095648:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836632.095649:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836632.095651:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787836632.095652:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836632.095654:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787836632.095657:0:15005:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787836632.095659:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787836632.095660:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787836632.095661:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836632.095662:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787836632.095663:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836632.095664:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836632.095666:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787836632.095666:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836632.095667:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787836632.095696:0:15005:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787836632.095716:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213440:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787836632.095802:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.095924:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d07bc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836632.096693:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193213440 00000100:00100000:2.0:1787836632.096704:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193213440 00000100:00100000:2.0:1787836632.096768:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787836632.096779:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:15005:x1874682193213440:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787836632.096836:0:14317:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787836632.096840:0:14317:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787836632.096844:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787836632.103708:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:15005:x1874682193213440:12345-0@lo:253:mount.lustre.0 Request processed in 6920us (7896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836632.103723:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787836632.103805:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213440:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787836632.103820:0:15005:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787836632.103823:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787836632.103825:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787836632.103827:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836632.103828:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836632.103829:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836632.103831:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836632.103832:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836632.103834:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836632.103835:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787836632.103858:0:15005:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e3c833e000 from lustre-OST0000 10000000:01000000:2.0:1787836632.103885:0:15005:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787836632.103887:0:15005:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787836632.103893:0:15005:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e2c1804ed8 local copy 00010000:00010000:2.0:1787836632.104010:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836632.104611:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787836632.104663:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.104753:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec600 going to sleep for 11 seconds 00000100:00100000:1.0:1787836632.104791:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193213568 00000100:00100000:1.0:1787836632.104799:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193213568 00000100:00100000:1.0:1787836632.104881:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787836632.104892:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:15005:x1874682193213568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787836632.105245:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:15005:x1874682193213568:12345-0@lo:501:mount.lustre.0 Request processed in 354us (580us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787836632.105253:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787836632.105537:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213568:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787836632.105563:0:15005:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787836632.105736:0:15005:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787836632.105745:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.105755:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836632.105784:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e3c833e000 10000000:01000000:2.0:1787836632.105788:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787836632.105794:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98e2c1804ed8 10000000:01000000:2.0:1787836632.105796:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787836632.105800:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98e2c1804ed8 from 1 10000000:01000000:2.0:1787836632.105803:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787836632.105833:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab85c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.105841:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab85c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.105849:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab85c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836632.105867:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787836632.106132:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836632.106203:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0981540 going to sleep for 11 seconds 00000100:00100000:1.0:1787836632.106329:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193213696 00000100:00100000:1.0:1787836632.106335:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193213696 00000100:00100000:1.0:1787836632.106486:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787836632.106496:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+12:15005:x1874682193213696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787836632.106507:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836632.106521:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab85ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab85c7 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.106543:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab85ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab85c7 expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.106554:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f4600/0x966835ea68ab85ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab85c7 expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.106563:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4600, rc 0) 00000100:00100000:1.0:1787836632.106614:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+13:15005:x1874682193213696:12345-0@lo:101:mount.lustre.0 Request processed in 119us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836632.106620:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787836632.106703:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787836632.106717:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab85c7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85ce expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.106726:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab85c7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab85ce expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836632.106742:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787836632.106754:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab85c7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85ce expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.106771:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b600/0x966835ea68ab85c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85ce expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836632.106779:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787836632.106784:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787836632.106789:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787836632.106791:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787836632.106812:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab85d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.106819:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab85d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.106825:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab85d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836632.106838:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787836632.106867:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.106966:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787836632.107187:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193213824 00000100:00100000:2.0:1787836632.107192:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193213824 00000100:00100000:2.0:1787836632.107218:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787836632.107224:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+13:15005:x1874682193213824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787836632.107231:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836632.107246:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a400/0x966835ea68ab85dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab85d5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.107272:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a400/0x966835ea68ab85dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab85d5 expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.107281:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a400/0x966835ea68ab85dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab85d5 expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.107288:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a400, rc 0) 00000100:00100000:2.0:1787836632.107373:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193213824:12345-0@lo:101:mount.lustre.0 Request processed in 149us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836632.107380:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787836632.107605:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787836632.107617:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab85d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85dc expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.107625:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab85d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab85dc expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787836632.108608:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787836632.110746:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787836632.111179:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787836632.111230:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787836632.111346:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787836632.111485:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787836632.111520:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787836632.111548:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787836632.111605:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787836632.111613:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787836632.111699:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787836632.111765:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.111801:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836632.112123:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193213952 00000100:00100000:2.0:1787836632.112131:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193213952 00000100:00100000:2.0:1787836632.112189:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787836632.112199:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193213952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836632.112799:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193213952:12345-0@lo:501:mount.lustre.0 Request processed in 599us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836632.112809:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787836632.113108:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193213952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787836632.113159:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836632.113210:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.113247:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836632.113369:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193214080 00000100:00100000:1.0:1787836632.113376:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193214080 00000100:00100000:1.0:1787836632.113427:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787836632.113436:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193214080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787836632.114216:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193214080:12345-0@lo:503:mount.lustre.0 Request processed in 777us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836632.114235:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787836632.114434:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787836632.115639:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787836632.115722:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787836632.115808:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.115945:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836632.116351:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193214208 00000100:00100000:2.0:1787836632.116436:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193214208 00000100:00100000:3.0:1787836632.116592:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787836632.116602:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193214208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787836632.116930:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193214208:12345-0@lo:502:mount.lustre.0 Request processed in 328us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836632.116940:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787836632.118761:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787836632.119146:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787836632.119200:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787836632.119226:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787836632.119457:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787836632.119494:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787836632.119520:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787836632.119557:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787836632.119585:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787836632.119611:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787836632.119654:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787836632.119683:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787836632.119722:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787836632.119760:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787836632.119829:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.122478:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836632.122504:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193214336 00000100:00100000:1.0:1787836632.122513:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193214336 00000100:00100000:1.0:1787836632.122590:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787836632.122600:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193214336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787836632.123122:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193214336:12345-0@lo:502:mount.lustre.0 Request processed in 522us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836632.123131:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787836632.123161:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787836632.123336:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787836632.123355:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787836632.125173:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787836632.125191:0:15019:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787836632.125200:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836632.125203:0:15019:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787836632.125209:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787836632.125227:0:15019:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98e3d83eced8) 00000020:00000080:0.0:1787836632.125445:0:15019:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787836632.125455:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787836632.125544:0:15019:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e3c833e000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787836632.125553:0:15019:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787836632.125561:0:15019:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x966835ea68ab85ea 00010000:00010000:0.0:1787836632.130653:0:15019:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787836632.131521:0:15019:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1787836632.138190:0:15019:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787836632.140275:0:15019:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787836632.140294:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787836632.140302:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836632.140305:0:15019:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787836632.140310:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787836632.140314:0:15019:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787836632.140315:0:15019:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787836632.140317:0:15019:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787836632.140318:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787836632.140320:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836632.140322:0:15019:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787836632.140324:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787836632.140327:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836632.140329:0:15019:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787836632.140332:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787836632.140334:0:15019:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787836632.140336:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787836632.140338:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836632.140339:0:15019:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787836632.140341:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787836632.140343:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836632.140344:0:15019:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787836632.140354:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787836632.141540:0:15019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787836632.141547:0:15019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787836632.141549:0:15019:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787836632.141553:0:15019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787836632.141730:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787836632.141771:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787836632.141794:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab85d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85dc expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.141807:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e2c13ac600/0x966835ea68ab85d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85dc expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836632.141817:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3c833e000 from 1 10000000:01000000:3.0:1787836632.141819:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787836632.141862:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.141870:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.141882:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836632.141919:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787836632.142017:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.142095:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787836632.142121:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193214464 00000100:00100000:3.0:1787836632.142128:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193214464 00000100:00100000:3.0:1787836632.142160:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787836632.142168:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+14:15005:x1874682193214464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787836632.142181:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836632.142197:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab85f1 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.142222:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.142240:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.142250:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e2c13ac200, rc 0) 00000100:00100000:3.0:1787836632.142286:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214464:12345-0@lo:101:mount.lustre.0 Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836632.142293:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787836632.142345:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787836632.142555:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.142562:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787836632.144193:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787836632.145077:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787836632.145587:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787836632.145689:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787836632.145763:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787836632.145772:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787836632.145889:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787836632.146037:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.146119:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787836632.147740:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193214592 00000100:00100000:2.0:1787836632.147752:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193214592 00000100:00100000:2.0:1787836632.147800:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787836632.147811:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836632.148302:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214592:12345-0@lo:501:mount.lustre.0 Request processed in 492us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836632.148322:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787836632.149463:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787836632.149530:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787836632.149596:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.149724:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787836632.149826:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193214720 00000100:00100000:3.0:1787836632.149833:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193214720 00000100:00100000:3.0:1787836632.149924:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787836632.149934:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836632.150187:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214720:12345-0@lo:503:mount.lustre.0 Request processed in 253us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836632.150194:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787836632.150284:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787836632.151451:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787836632.151566:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787836632.151919:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.151992:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836632.152183:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193214848 00000100:00100000:2.0:1787836632.152192:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193214848 00000100:00100000:2.0:1787836632.152253:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787836632.152264:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787836632.152517:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214848:12345-0@lo:502:mount.lustre.0 Request processed in 254us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836632.152525:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787836632.152797:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787836632.153044:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787836632.153152:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787836632.153200:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787836632.153236:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787836632.153266:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787836632.153311:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787836632.153346:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787836632.153395:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787836632.153439:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787836632.153488:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.153526:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836632.153797:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193214976 00000100:00100000:2.0:1787836632.153802:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193214976 00000100:00100000:2.0:1787836632.153831:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787836632.154526:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787836632.154912:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193214976:12345-0@lo:502:mount.lustre.0 Request processed in 1073us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836632.154919:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787836632.155097:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193214976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787836632.155239:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787836632.155252:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787836632.157876:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836632.157890:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836632.157893:0:15023:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787836632.157898:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e3c833e000 00000020:00000080:1.0:1787836632.157901:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787836632.157908:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836632.157911:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836632.157912:0:15023:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787836632.157915:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836632.157917:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836632.157919:0:15023:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787836632.157922:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e3c833e000 00000020:00000080:1.0:1787836632.157924:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787836632.158038:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836632.158043:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836632.158045:0:15023:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787836632.158047:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787836632.158050:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836632.158051:0:15023:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787836632.158054:0:15023:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e3c833e000 00000020:00000080:1.0:1787836632.158467:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787836632.158520:0:15023:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787836632.158536:0:15023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787836632.158538:0:15023:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787836632.158542:0:15023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787836632.165933:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787836632.165985:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787836632.166013:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.166027:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836632.166099:0:15005:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787836632.166102:0:15005:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e3c833e000 10000000:01000000:0.0:1787836632.166106:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e3c833e000 10000000:01000000:0.0:1787836632.166110:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787836632.166117:0:15005:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e3c833e000 from 1 10000000:01000000:0.0:1787836632.166119:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787836632.166157:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3f800/0x966835ea68ab85ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.166166:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e401d3f800/0x966835ea68ab85ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.166180:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e401d3f800/0x966835ea68ab85ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836632.166213:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787836632.166298:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.166372:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836632.167489:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193215104 00000100:00100000:2.0:1787836632.167499:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193215104 00000100:00100000:2.0:1787836632.167938:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787836632.167949:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193215104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787836632.167966:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836632.168042:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005b400/0x966835ea68ab8606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab85ff expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.168092:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005b400/0x966835ea68ab8606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab85ff expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.168104:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005b400/0x966835ea68ab8606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab85ff expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.168122:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b400, rc 0) 00000100:00100000:2.0:1787836632.168191:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215104:12345-0@lo:101:mount.lustre.0 Request processed in 244us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836632.168198:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787836632.168513:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787836632.168542:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e401d3f800/0x966835ea68ab85ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8606 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.168551:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e401d3f800/0x966835ea68ab85ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab8606 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787836632.171461:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787836632.175441:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787836632.175803:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787836632.175848:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787836632.175884:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787836632.175932:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787836632.175985:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787836632.176043:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787836632.176106:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787836632.176142:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787836632.176192:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787836632.176227:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787836632.176264:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787836632.176316:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787836632.176355:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787836632.176391:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787836632.176474:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787836632.176515:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787836632.176562:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787836632.176617:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787836632.176654:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787836632.176686:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787836632.176734:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787836632.176770:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787836632.176804:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787836632.179558:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787836632.179750:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787836632.179790:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787836632.179844:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787836632.179883:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787836632.182171:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787836632.182209:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787836632.182356:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787836632.183922:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.184093:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193215232 00000100:00100000:3.0:1787836632.184101:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193215232 00000100:00100000:3.0:1787836632.184158:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787836632.184168:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787836632.184910:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eecb40 going to sleep for 11 seconds 00010000:00010000:2.0:1787836632.185107:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836632.186602:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215232:12345-0@lo:501:mount.lustre.0 Request processed in 2423us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836632.186617:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787836632.187731:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787836632.187787:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787836632.187849:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.187894:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787836632.188047:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193215360 00000100:00100000:3.0:1787836632.188054:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193215360 00000100:00100000:3.0:1787836632.188109:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787836632.188117:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836632.188309:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215360:12345-0@lo:503:mount.lustre.0 Request processed in 192us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836632.188317:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787836632.189577:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787836632.195364:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787836632.195626:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c26492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787836632.195731:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836632.195784:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3f6e71900 going to sleep for 11 seconds 00000100:00100000:0.0:1787836632.195833:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193215488 00000100:00100000:0.0:1787836632.195841:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193215488 00000100:00100000:0.0:1787836632.195892:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787836632.195903:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787836632.196154:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215488:12345-0@lo:502:mount.lustre.0 Request processed in 251us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836632.196162:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787836632.196726:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c26492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787836632.196966:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787836632.197014:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787836632.197041:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787836632.197106:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787836632.197139:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787836632.197199:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787836632.197238:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787836632.197264:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787836632.197301:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787836632.197329:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787836632.197354:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787836632.198943:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787836632.199016:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787836632.199051:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787836632.199127:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787836632.199157:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787836632.199186:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787836632.199228:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787836632.199264:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787836632.199299:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787836632.199347:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787836632.200155:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787836632.200193:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787836632.200256:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787836632.200284:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787836632.200310:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787836632.200347:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787836632.200462:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787836632.200501:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787836632.200551:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787836632.200651:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787836632.200767:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787836632.200807:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787836632.200856:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787836632.200967:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787836632.201017:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787836632.201053:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787836632.201242:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787836632.201325:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787836632.201455:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787836632.201511:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c26492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787836632.201644:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.201736:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193215616 00000100:00100000:3.0:1787836632.201743:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193215616 00000100:00100000:1.0:1787836632.201755:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3f6e71900 going to sleep for 11 seconds 00000100:00100000:3.0:1787836632.201793:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787836632.201803:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787836632.202096:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193215616:12345-0@lo:502:mount.lustre.0 Request processed in 294us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836632.202105:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787836632.206590:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c26492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193215616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787836632.206761:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787836632.206778:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787836632.208167:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787836632.208183:0:15028:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98e3d83eb490) 00000020:00000080:0.0:1787836632.208204:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787836632.208289:0:15028:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e3c833e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787836632.208293:0:15028:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e3c833e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787836632.208296:0:15028:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e3c833e000 3 00010000:00080000:0.0:1787836632.208336:0:15028:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e401cf2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1787836632.209943:0:15028:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787836632.210187:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787836632.210219:0:15028:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787836632.210231:0:15028:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x966835ea68ab8614 00000100:00080000:0.0:1787836632.210241:0:15028:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787836632.210247:0:15028:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98e401cf2800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1787836632.210285:0:15028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3fadc03c0 x1874682193215744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787836632.210312:0:15028:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787836632.210580:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787836632.210586:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787836632.210599:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787836632.210602:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787836632.210658:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787836632.210672:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193215872:0@lo:400:kworker.0 00000100:00100000:3.0:1787836632.210742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.210795:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193215872 00000100:00100000:3.0:1787836632.210802:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193215872 00000100:00100000:3.0:1787836632.210848:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836632.210858:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c3788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193215872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836632.210909:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c3788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193215872:12345-0@lo:400:kworker.0 Request processed in 53us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836632.210916:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787836632.210954:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c378b480 x1874682193215872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836632.210967:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193215872:0@lo:400:kworker.0 00000100:00100000:1.0:1787836632.211399:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874682193215744:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787836632.211455:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836632.213617:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193215744 00000100:00100000:3.0:1787836632.213630:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193215744 00000100:00100000:3.0:1787836632.213675:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787836632.213681:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c26492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874682193215744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787836632.213707:0:14325:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1787836632.213748:0:14325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x966835ea68ab861b 00000004:00100000:3.0:1787836632.213764:0:14325:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787836632.213797:0:14325:0:(import.c:65:import_set_state_nolock()) ffff98e401d42800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787836632.213880:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c26492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874682193215744:12345-0@lo:38:llog_process_th.0 Request processed in 197us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836632.213898:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787836632.213956:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3fadc03c0 x1874682193215744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787836642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836632.213980:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787836632.213990:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787836632.213998:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787836632.214002:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787836632.214005:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e401cf2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787836632.214011:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874682193215744:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787836632.217211:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787836632.217460:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787836632.217494:0:15005:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787836632.217517:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3f800/0x966835ea68ab85ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8606 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836632.217531:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e401d3f800/0x966835ea68ab85ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8606 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787836632.217586:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787836632.217589:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787836632.217590:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836632.217591:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836632.217593:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836632.217594:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836632.217595:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836632.217598:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836632.217599:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787836632.217603:0:15005:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787836632.217606:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787836632.217608:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787836632.217609:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836632.217610:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836632.217611:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836632.217612:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836632.217613:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836632.217614:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836632.217615:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787836632.217649:0:15005:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787836632.217678:0:15005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193216000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787836632.217767:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.217808:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193216000 00000100:00100000:0.0:1787836632.217817:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193216000 00000100:00100000:2.0:1787836632.217818:0:15005:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c19123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836632.218095:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787836632.218107:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15005:x1874682193216000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787836632.218141:0:14317:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787836632.218160:0:14317:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787836632.268113:0:14317:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787836632.268131:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787836632.268168:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787836632.268175:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787836632.268207:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.268229:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8588 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.268238:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.268286:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab8588 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.268324:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab8588 expref: 16 pid: 14318 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836632.268341:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1874682193216128:0@lo:104: 00000100:00100000:0.0:1787836632.269153:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836632.269216:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec300 going to sleep for 11 seconds 00000100:00100000:1.0:1787836632.270328:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193216128 00000100:00100000:1.0:1787836632.270339:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193216128 00000100:00100000:1.0:1787836632.270395:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836632.270437:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:14339:x1874682193216128:12345-0@lo:104: 00010000:00010000:1.0:1787836632.270455:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.270549:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787836632.270556:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:14339:x1874682193216128:12345-0@lo:104: Request processed in 129us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836632.270565:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787836632.270581:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1874682193216128:0@lo:104: 00010000:00010000:3.0:1787836632.270719:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836632.270728:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.270737:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f000 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:3.0:1787836632.270741:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.270750:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787836632.270758:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787836632.270763:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787836632.270809:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.270816:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787836632.270846:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.270986:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e401d3f000/0x966835ea68ab8588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab858f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836632.271004:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836632.271006:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836632.271008:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836632.271028:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193216256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787836632.271102:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787836632.271185:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836632.271835:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193216256 00000100:00100000:1.0:1787836632.271842:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193216256 00010000:00010000:1.0:1787836632.271866:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8588 expref: 17 pid: 14318 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836632.271892:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836632.271899:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:3310:x1874682193216256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787836632.271910:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836632.271916:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8588 expref: 17 pid: 14318 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.271927:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab8588 expref: 17 pid: 14318 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.271942:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f5e00/0x966835ea68ab858f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab8588 expref: 17 pid: 14318 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.271967:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.271976:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787836632.272005:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003831559s 00010000:00010000:1.0:1787836632.272010:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.272017:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.272023:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.272030:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.272036:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836632.272052:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.272083:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.272105:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836632.272117:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836632.272157:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836632.272167:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836632.272176:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:3310:x1874682193216256:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (1071us total) trans 0 rc 0/0 00010000:00010000:0.0:1787836632.272176:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e401d3f200/0x966835ea68ab8622 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836632.272193:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787836632.272247:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193216256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787836632.296274:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:15005:x1874682193216000:12345-0@lo:253:mount.lustre.0 Request processed in 78149us (78486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836632.296294:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787836632.296514:0:15005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15005:1874682193216000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787836632.296535:0:15005:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787836632.296538:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787836632.296539:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787836632.296541:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836632.296542:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836632.296543:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836632.296544:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836632.296545:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836632.296547:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836632.296549:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787836632.296564:0:15005:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787836632.305195:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787836632.305635:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787836632.305805:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787836632.305980:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787836632.306150:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787836632.306584:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787836632.308571:0:15005:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787836632.387160:0:15005:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787836632.387170:0:15005:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787836632.387226:0:15005:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787836632.387313:0:15005:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787836632.387330:0:15005:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787836632.387377:0:15005:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787836633.200731:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787836634.099442:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787836634.099450:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e3fabd3000 from 7 10000000:01000000:0.0:1787836634.099455:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787836634.099501:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836634.099513:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836634.099536:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836634.099561:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193216384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787836634.099632:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836634.099693:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1912180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836634.099770:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193216384 00000100:00100000:2.0:1787836634.099779:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193216384 00000100:00100000:2.0:1787836634.099838:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787836634.099848:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+15:14321:x1874682193216384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836634.099860:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836634.099874:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab8629 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836634.099898:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab8629 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836634.099909:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8629 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836634.099917:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836634.099992:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:14321:x1874682193216384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836634.100000:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787836634.100243:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193216384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836634.100266:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836634.100275:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836634.100319:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193216512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787836634.100347:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836634.100375:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c1912180 going to sleep for 11 seconds 00000100:00100000:1.0:1787836634.100428:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193216512 00000100:00100000:1.0:1787836634.100432:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193216512 00000100:00100000:1.0:1787836634.100453:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787836634.100466:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:14321:x1874682193216512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787836634.100479:0:14317:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787836634.100491:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787836634.100494:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787836634.100569:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:14321:x1874682193216512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836634.100576:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787836634.100738:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193216512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787836634.100806:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787836634.100812:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836634.100820:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836634.222211:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836635.253601:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836636.270465:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836637.294935:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787836637.425053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787836637.425077:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787836637.425080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787836637.425084:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787836637.425123:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836637.425144:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193216640:0@lo:400:kworker.0 00000100:00100000:1.0:1787836637.425217:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836637.425272:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193216768:0@lo:400:kworker.0 00000100:00100000:1.0:1787836637.425298:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836637.425319:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836637.425325:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193216896:0@lo:400:kworker.0 00000100:00100000:1.0:1787836637.425348:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836637.425390:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193216640 00000100:00100000:1.0:1787836637.425396:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193216640 00000100:00100000:1.0:1787836637.425444:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787836637.425453:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:3310:x1874682193216640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836637.425526:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:3310:x1874682193216640:12345-0@lo:400:kworker.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836637.425551:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787836637.425590:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193216768 00000100:00100000:1.0:1787836637.425594:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193216768 00000100:00100000:1.0:1787836637.425615:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193216896 00000100:00100000:1.0:1787836637.425618:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193216896 00000100:00100000:1.0:1787836637.425656:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836637.425663:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193216768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836637.425701:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193216768:12345-0@lo:400:kworker.0 Request processed in 39us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836637.425707:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836637.425719:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836637.425725:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193216896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836637.425764:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193216896:12345-0@lo:400:kworker.0 Request processed in 39us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836637.425769:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787836637.425810:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787836637.425840:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c264a580 x1874682193216896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836637.425854:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193216896:0@lo:400:kworker.0 00010000:00080000:1.0:1787836637.425864:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c264b0c0 x1874682193216768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836637.425872:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193216768:0@lo:400:kworker.0 00000100:00100000:1.0:1787836637.425898:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193216640:0@lo:400:kworker.0 00010000:00010000:2.0:1787836638.323171:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836639.346783:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836640.040587:0:15372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787836640.368933:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787836640.750765:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787836641.392096:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836642.414391:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787836642.552236:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787836642.552243:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787836642.552246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787836642.552249:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787836642.552311:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193217152:0@lo:400:kworker.0 00000100:00100000:3.0:1787836642.552411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836642.552430:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193217280:0@lo:400:kworker.0 00000100:00100000:0.0:1787836642.552463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836642.552466:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787836642.552472:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3311:1874682193217024:0@lo:400:kworker.0 00000100:00100000:3.0:1787836642.552499:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836642.555923:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193217024 00000100:00100000:2.0:1787836642.555937:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193217024 00000100:00100000:2.0:1787836642.555994:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787836642.556017:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:3311:x1874682193217024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836642.556121:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:3311:x1874682193217024:12345-0@lo:400:kworker.0 Request processed in 118us (3620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836642.556129:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787836642.556417:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3311:1874682193217024:0@lo:400:kworker.0 00000100:00100000:1.0:1787836642.557155:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193217152 00000100:00100000:1.0:1787836642.557163:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193217152 00000100:00100000:1.0:1787836642.557207:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193217280 00000100:00100000:1.0:1787836642.557211:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193217280 00000100:00100000:1.0:1787836642.557240:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836642.557248:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193217152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836642.557323:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193217152:12345-0@lo:400:kworker.0 Request processed in 75us (4912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836642.557329:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836642.557360:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836642.557366:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193217280:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787836642.557383:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3fadc0780 x1874682193217152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836642.557398:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193217152:0@lo:400:kworker.0 00000100:00100000:1.0:1787836642.557409:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193217280:12345-0@lo:400:kworker.0 Request processed in 44us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836642.557415:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787836642.557435:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787836642.557564:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e3fadc2940 x1874682193217280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836642.557575:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193217280:0@lo:400:kworker.0 00010000:00010000:1.0:1787836643.442294:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836643.502609:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787836628/real 1787836628] req@ffff98e2c378a940 x1874682193213056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787836643 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836643.502643:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e2c378a940 x1874682193213056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787836643 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836643.502653:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787836628/real 1787836628] req@ffff98e2c3789680 x1874682193213184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787836643 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836643.502665:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98e2c3789680 x1874682193213184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787836643 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787836643.502695:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7e1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787836643.502722:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787836643.502726:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193213056:0@lo:8:kworker.0 00000100:00080000:3.0:1787836643.502733:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787836643.502738:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787836643.502741:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3789680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193213184:0@lo:8:kworker.0 00000100:00080000:1.0:1787836643.502935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787836643.502940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787836643.502944:0:36:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7e1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787836643.502949:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1787836643.502954:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787836643.502960:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98e3ef7e1800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1787836643.502978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c264a940 x1874682193217536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787836643.502998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787836643.503001:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787836643.503002:0:36:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787836643.503005:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1787836643.503008:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787836643.503012:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e3ef7fd000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1787836643.503026:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c264b0c0 x1874682193217664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787836643.503083:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787836643.503096:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193217408:0@lo:400:kworker.0 00000100:00100000:1.0:1787836643.503160:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836643.503216:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c26483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193217920:0@lo:400:kworker.0 00000100:00100000:1.0:1787836643.503242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836643.503263:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836643.503268:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193217792:0@lo:400:kworker.0 00000100:00100000:1.0:1787836643.503288:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836643.503315:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193217408 00000100:00100000:1.0:1787836643.503321:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193217408 00000100:00100000:1.0:1787836643.503384:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787836643.503395:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:3312:x1874682193217408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836643.503450:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:3312:x1874682193217408:12345-0@lo:400:kworker.0 Request processed in 57us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836643.503457:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787836643.503493:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193217920 00000100:00100000:1.0:1787836643.503497:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193217920 00000100:00100000:1.0:1787836643.503531:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193217792 00000100:00100000:1.0:1787836643.503535:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193217792 00000100:00100000:1.0:1787836643.503547:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787836643.503553:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193217920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836643.503588:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874682193217920:12345-0@lo:400:kworker.0 Request processed in 34us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836643.503593:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787836643.503605:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787836643.503610:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193217792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836643.503633:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874682193217792:12345-0@lo:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836643.503639:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787836643.503676:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c2648b40 x1874682193217792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836643.503820:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874682193217792:0@lo:400:kworker.0 00010000:00080000:1.0:1787836643.503835:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c26483c0 x1874682193217920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836643.503845:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c26483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874682193217920:0@lo:400:kworker.0 00000100:00100000:1.0:1787836643.503882:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193217408:0@lo:400:kworker.0 00000100:00100000:3.0:1787836643.504009:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193217536:0@lo:8:kworker.0 00000100:00100000:3.0:1787836643.504051:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836643.504114:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193217664:0@lo:8:kworker.0 00000100:00100000:3.0:1787836643.504137:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836643.504172:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193217536 00000100:00100000:3.0:1787836643.504184:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193217536 00000100:00100000:3.0:1787836643.504212:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193217664 00000100:00100000:3.0:1787836643.504215:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193217664 00000100:00100000:3.0:1787836643.504227:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787836643.504231:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c3789680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874682193217536:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787836643.504258:0:15008:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:3.0:1787836643.504287:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab8637 00002000:00100000:3.0:1787836643.504300:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98e3ee572800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113961 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787836643.504304:0:15008:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787836643.504307:0:15008:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787836643.504673:0:15008:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787836643.504715:0:15008:0:(import.c:65:import_set_state_nolock()) ffff98e3ee577000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787836643.504767:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c3789680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874682193217536:12345-0@lo:8:kworker.0 Request processed in 534us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836643.504774:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787836643.504791:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836643.504796:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874682193217664:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787836643.504806:0:15008:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787836643.504830:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874682193217664:12345-0@lo:8:kworker.0 Request processed in 32us (691us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787836643.504836:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787836643.504867:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c264a940 x1874682193217536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787836663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836643.505013:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787836643.505020:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787836643.505028:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787836643.505042:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787836643.505045:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7e1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787836643.505090:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787836643.505096:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193217536:0@lo:8:kworker.0 00000100:00080000:3.0:1787836643.505111:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787836643.505114:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787836643.505117:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193217664:0@lo:8:kworker.0 00000004:00080000:3.0:1787836643.505169:0:14346:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787836643.505188:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14346:1874682193218176:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787836643.505216:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836643.505233:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0500600 going to sleep for 11 seconds 00000100:00100000:3.0:1787836643.505244:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787836643.505251:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193218048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836643.505275:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836643.505300:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193218176 00000100:00100000:3.0:1787836643.505305:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193218176 00000100:00100000:3.0:1787836643.505350:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787836643.505357:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c3788b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14346:x1874682193218176:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787836643.506894:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193218048 00000100:00100000:1.0:1787836643.506905:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193218048 00000100:00100000:1.0:1787836643.506947:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836643.506956:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c3788f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874682193218048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787836643.506986:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836643.507071:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c3788f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874682193218048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836643.507092:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1787836643.509856:0:14345:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787836643.510152:0:14345:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491943092548ns, next at 0ns, rc = 0 00000100:00080000:3.0:1787836643.518243:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787836643.518321:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c378bc00 x1874682193218048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836643.518361:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193218048:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1787836643.527749:0:15008:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787836643.527763:0:15008:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787836643.527768:0:15008:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1787836643.549762:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.549781:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.549800:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787836643.549805:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.549811:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.549828:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.549840:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.549848:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.550474:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787836643.555854:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.556230:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.556249:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787836643.556254:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.556260:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.556275:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.556297:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.556305:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.556338:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787836643.557124:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836643.557134:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557143:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836643.557148:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557156:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557178:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557185:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000632540d8/0x966835ea68ab863e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557204:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836643.557207:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557212:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13adc00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836643.557215:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557233:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557243:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557249:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d32e0806/0x966835ea68ab8645 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.557260:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836643.557262:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836643.557264:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.560995:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.561010:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561026:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787836643.561030:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.561037:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561053:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561084:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561093:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561125:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.561139:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.561145:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561153:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.561157:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561165:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561183:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561191:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d41c7272/0x966835ea68ab864c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561211:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.561213:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.561214:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.561788:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.561795:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561806:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787836643.561815:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.561820:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561830:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561838:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561845:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561860:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.561872:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.561876:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561883:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ade00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.561886:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561894:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561905:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561923:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abc640f0/0x966835ea68ab8653 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.561938:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.561940:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.561941:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.562389:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.562395:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562405:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787836643.562408:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.562412:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562422:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562430:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562437:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562451:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.562460:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.562469:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562477:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.562480:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562487:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562499:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562506:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbe10fc7/0x966835ea68ab865a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.562519:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.562520:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.562522:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.563722:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.563731:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.563744:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787836643.563748:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.563753:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.563774:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.563783:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.563790:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.563808:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.563823:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.563827:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.563835:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad800 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.563838:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.563846:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.563859:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.564027:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.567188:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbc0145/0x966835ea68ab8661 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.567253:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.567255:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.567258:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.571861:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.571886:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.571903:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.571908:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.571914:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.571930:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.571941:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.571950:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.571971:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.571986:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.571991:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572010:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac800 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.572014:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572024:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572040:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572047:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3bfb5ad/0x966835ea68ab8668 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572082:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.572084:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.572086:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.572604:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.572610:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572632:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.572635:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.572641:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572651:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572665:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572673:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572687:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.572696:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.572700:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572707:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13aca00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.572710:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572718:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572728:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572735:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b33a7f/0x966835ea68ab866f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.572748:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.572753:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.572755:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.573600:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.573607:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573619:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.573623:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.573628:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573638:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573646:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573654:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573668:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.573675:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.573679:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573686:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ad200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.573689:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573707:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573719:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573726:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3f8981e/0x966835ea68ab8676 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.573741:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.573742:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.573743:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.574130:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.574137:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574146:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.574149:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.574154:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574164:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574171:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574183:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574195:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.574203:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.574206:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574213:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ada00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.574217:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574225:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574235:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574242:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009637450e/0x966835ea68ab867d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574254:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.574255:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.574257:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.574615:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.574627:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574635:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.574639:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.574643:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574653:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574661:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574669:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574680:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.574687:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.574691:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574697:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ac400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.574701:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574708:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574724:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574732:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8819c90/0x966835ea68ab8684 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.574745:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.574746:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.574748:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.575119:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.575126:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575135:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.575138:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.575142:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575151:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575159:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575167:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575190:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.575198:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.575202:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575208:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13acc00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.575210:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575217:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575227:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575234:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc5af5a1/0x966835ea68ab868b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.575247:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.575248:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.575250:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.594864:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.594883:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.594907:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.594921:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.594929:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.594947:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.594959:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.594967:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.594996:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787836643.596618:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836643.596644:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.596657:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836643.596662:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.596672:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.596693:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.596715:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005881163f/0x966835ea68ab8692 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.596738:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836643.596740:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836643.596742:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.600998:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.601012:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601028:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.601033:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.601039:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601053:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601081:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601096:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601115:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.601131:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.601136:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601144:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.601148:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601157:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601173:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601181:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab8699 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601199:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.601200:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.601202:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.601739:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.601754:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601764:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.601767:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.601771:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601782:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601790:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601797:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.601811:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787836643.602026:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836643.602033:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.602042:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152ac00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836643.602046:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.602054:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.602080:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.602087:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044680970/0x966835ea68ab86a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836643.602104:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836643.602106:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836643.602107:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787836643.608379:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787836643.613202:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.613220:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.613241:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.613247:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.613254:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.613269:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.613288:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.613295:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.613324:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836643.613814:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836643.613822:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.613832:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836643.613837:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.613846:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.613878:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.613887:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab86a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.613910:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.613917:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.613919:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.635553:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.635568:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.635586:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.635591:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.635597:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.635611:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.639527:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.639552:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.639614:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787836643.640511:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.640523:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.640541:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.640546:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.640553:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.640567:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.640575:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.640582:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.640605:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787836643.646263:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787836643.646285:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646302:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.646340:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646353:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646381:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646390:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066412629/0x966835ea68ab86ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646422:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.646426:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646432:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.646434:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646442:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646452:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646460:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.646483:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.646485:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.646487:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.654746:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.654758:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654776:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.654781:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.654788:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654803:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654815:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654822:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654845:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836643.654859:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.654865:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654883:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.654888:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654896:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654914:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654922:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab86bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.654942:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.654944:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.654946:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836643.656500:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.665416:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.665435:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.665455:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.665461:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.665467:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.665482:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.665506:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.665513:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.665541:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787836643.666089:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836643.666098:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.666108:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152be00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836643.666113:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.666132:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.666155:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.666162:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002bbbff1/0x966835ea68ab86c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.666182:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836643.666184:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836643.666187:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.672527:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.672540:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.672556:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.672561:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.672568:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.672582:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.672593:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.672601:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.672659:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787836643.673140:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.673147:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673157:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787836643.673160:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.673165:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673175:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673183:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673191:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673212:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787836643.673228:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787836643.673233:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673242:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.673253:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673263:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673282:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673290:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091611132/0x966835ea68ab86ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673309:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836643.673312:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.673319:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a800 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836643.673322:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.678569:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.678597:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.678605:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3e0da37/0x966835ea68ab86d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.678656:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.678658:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.678661:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787836643.680583:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787836643.680597:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.680617:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787836643.682514:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836643.682947:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836643.682961:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.682984:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.682997:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836643.683005:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.689721:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836643.691508:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836643.691520:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.691533:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836643.691538:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.691550:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.691570:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.691578:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba6bf8c1/0x966835ea68ab86d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.691596:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.691598:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.691600:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787836643.692135:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787836643.692145:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.692158:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787836643.692162:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836643.692167:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.692180:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.692302:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.692317:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.692537:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836643.692574:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836643.692582:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.692590:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005aa00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836643.692593:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.692609:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.692641:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.692651:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096ae58b1/0x966835ea68ab86df lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.692673:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.692675:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.692678:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787836643.693505:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787836643.693514:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.693526:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787836643.693530:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836643.693537:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.693549:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.693557:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.693565:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.693591:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836643.694750:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836643.694760:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.694773:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005be00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836643.694778:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.694788:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.694811:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.694835:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025a2f45b/0x966835ea68ab86e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.694855:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.694857:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.694859:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787836643.698566:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787836643.698584:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.698615:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787836643.698621:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836643.698629:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.698647:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.698659:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.698668:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.698698:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836643.698968:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836643.698977:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.698987:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005ba00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836643.698993:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.699003:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.699023:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.699043:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017e5b935/0x966835ea68ab86ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.699089:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.699091:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.699093:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787836643.699267:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787836643.699274:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.699282:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787836643.699286:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787836643.699290:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.699300:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.699319:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.699326:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836643.699357:0:15008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787836643.699535:0:15008:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787836643.699636:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c3788b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14346:x1874682193218176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 194276us (194416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836643.699650:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787836643.701248:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836643.701259:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.701275:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836643.701278:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.701288:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.701308:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.701315:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efce9cef/0x966835ea68ab86f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836643.701344:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.701346:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836643.701348:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836643.702916:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14346:1874682193218176:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787836643.702936:0:14346:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787836643.702991:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14346:1874682193218304:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787836643.703227:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836643.703273:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0500600 going to sleep for 11 seconds 00000100:00100000:0.0:1787836643.703989:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193218304 00000100:00100000:0.0:1787836643.703999:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193218304 00000100:00100000:0.0:1787836643.704081:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787836643.704094:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14346:x1874682193218304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787836643.704153:0:15007:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787836643.719353:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14346:1874682193218304:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787836643.719370:0:14346:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:2.0:1787836643.725315:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14346:x1874682193218304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15101us (15965us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787836643.725342:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787836644.467835:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836645.486523:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836646.511502:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836647.534381:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787836647.725446:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787836647.725660:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:01000004:2.0:1787836648.426826:0:15724:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787836648.426831:0:15724:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787836648.426979:0:15724:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98e2c2db7800 00000020:01000004:2.0:1787836648.426996:0:15724:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787836648.427009:0:15724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787836648.427023:0:15724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98e3c69f0000) 00000020:00000080:2.0:1787836648.427041:0:15724:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787836648.443469:0:15724:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787836648.443717:0:15724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787836648.444563:0:15724:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787836648.444788:0:15724:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787836648.445229:0:15724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787836648.445585:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 501: rc = 0 00100000:10000000:3.0:1787836648.445683:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 501: rc = 0 00100000:10000000:3.0:1787836648.445778:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 501: rc = 0 00100000:10000000:3.0:1787836648.446403:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 287: rc = 0 00100000:10000000:3.0:1787836648.446746:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 287: rc = 0 00100000:10000000:3.0:1787836648.447261:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 287: rc = 0 00100000:10000000:3.0:1787836648.447533:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 287: rc = 0 00100000:10000000:3.0:1787836648.447803:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 287: rc = 0 00100000:10000000:3.0:1787836648.448139:0:15724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 287: rc = 0 00000020:00000080:3.0:1787836648.449567:0:15724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787836648.449580:0:15724:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787836648.449591:0:15724:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x966835ea68ab8702 00000020:01000004:3.0:1787836648.449600:0:15724:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787836648.449623:0:15724:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787836648.449627:0:15724:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787836648.449633:0:15724:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787836648.449654:0:15724:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787836648.449664:0:15724:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787836648.458474:0:15724:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787836648.458511:0:15724:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.125@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787836648.458515:0:15724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787836648.458517:0:15724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787836648.458518:0:15724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836648.458523:0:15724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836648.458524:0:15724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836648.458525:0:15724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836648.458527:0:15724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836648.458529:0:15724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836648.458530:0:15724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787836648.458534:0:15724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787836648.458536:0:15724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787836648.458537:0:15724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787836648.458538:0:15724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787836648.458539:0:15724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787836648.458540:0:15724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787836648.458541:0:15724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787836648.458542:0:15724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787836648.458543:0:15724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787836648.458544:0:15724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787836648.458568:0:15724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787836648.458589:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787836648.458661:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.458774:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f5d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787836648.458914:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193218432 00000100:00100000:1.0:1787836648.458922:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193218432 00000100:00100000:1.0:1787836648.459006:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787836648.459016:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15724:x1874682193218432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787836648.459055:0:14319:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787836648.459089:0:14319:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787836648.459094:0:14319:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787836648.463738:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15724:x1874682193218432:12345-0@lo:253:mount.lustre.0 Request processed in 4715us (5067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836648.463754:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787836648.463868:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787836648.463885:0:15724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787836648.463888:0:15724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787836648.463890:0:15724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787836648.463891:0:15724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787836648.463892:0:15724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787836648.463894:0:15724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787836648.463895:0:15724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787836648.463896:0:15724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787836648.463898:0:15724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787836648.463899:0:15724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787836648.463919:0:15724:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98e2c2db7800 from lustre-OST0001 10000000:01000000:0.0:1787836648.463945:0:15724:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787836648.463948:0:15724:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787836648.463957:0:15724:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98e2c1804ed8 local copy 00010000:00010000:0.0:1787836648.463969:0:15724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836648.464226:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787836648.464259:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836648.464554:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eeca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787836648.464595:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193218560 00000100:00100000:2.0:1787836648.464601:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193218560 00000100:00100000:3.0:1787836648.464642:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787836648.464652:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15724:x1874682193218560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787836648.464800:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15724:x1874682193218560:12345-0@lo:501:mount.lustre.0 Request processed in 148us (539us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787836648.464807:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787836648.464926:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218560:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787836648.464943:0:15724:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787836648.465112:0:15724:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787836648.465120:0:15724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.465130:0:15724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005b000/0x966835ea68ab84af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab84b6 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836648.465168:0:15724:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98e2c2db7800 10000000:01000000:0.0:1787836648.465173:0:15724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787836648.465178:0:15724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787836648.465180:0:15724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787836648.465184:0:15724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787836648.465187:0:15724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787836648.465208:0:15724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.465216:0:15724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.465225:0:15724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836648.465237:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787836648.465263:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836648.465278:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eeca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836648.465349:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193218688 00000100:00100000:3.0:1787836648.465354:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193218688 00000100:00100000:3.0:1787836648.465373:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787836648.465378:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:15724:x1874682193218688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787836648.465386:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836648.465397:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c152a800/0x966835ea68ab8710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab8709 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836648.465418:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152a800/0x966835ea68ab8710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab8709 expref: 17 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836648.465429:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c152a800/0x966835ea68ab8710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8709 expref: 17 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836648.465438:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a800, rc 0) 00000100:00100000:3.0:1787836648.465461:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193218688:12345-0@lo:101:mount.lustre.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836648.465466:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787836648.465524:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787836648.465536:0:15724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8710 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.465544:0:15724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab8710 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787836648.466038:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787836648.466927:0:15724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787836648.467319:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787836648.467368:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787836648.467395:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787836648.467433:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787836648.467462:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787836648.467489:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787836648.467541:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787836648.467548:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787836648.467618:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787836648.467673:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836648.467750:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836648.467872:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193218816 00000100:00100000:2.0:1787836648.467879:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193218816 00000100:00100000:1.0:1787836648.467997:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787836648.468009:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193218816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787836648.468391:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193218816:12345-0@lo:501:mount.lustre.0 Request processed in 385us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836648.468399:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787836648.468501:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787836648.468536:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787836648.468571:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836648.468590:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836648.468636:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193218944 00000100:00100000:1.0:1787836648.468640:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193218944 00000100:00100000:1.0:1787836648.468658:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787836648.468663:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193218944:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787836648.469039:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193218944:12345-0@lo:503:mount.lustre.0 Request processed in 374us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836648.469046:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787836648.469235:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193218944:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787836648.470307:0:15724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787836648.470382:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787836648.470448:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836648.470491:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836648.470554:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193219072 00000100:00100000:2.0:1787836648.470560:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193219072 00000100:00100000:2.0:1787836648.470601:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787836648.470611:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193219072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787836648.470934:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193219072:12345-0@lo:502:mount.lustre.0 Request processed in 324us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.470941:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787836648.471033:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787836648.471269:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787836648.471330:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787836648.471367:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787836648.471416:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787836648.471449:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787836648.471479:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787836648.471521:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787836648.471561:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787836648.471601:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787836648.471626:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787836648.471666:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836648.471705:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3eec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836648.471768:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193219200 00000100:00100000:2.0:1787836648.471775:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193219200 00000100:00100000:2.0:1787836648.471848:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787836648.471863:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193219200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787836648.472011:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193219200:12345-0@lo:502:mount.lustre.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.472019:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787836648.472271:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787836648.472355:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787836648.472366:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787836648.473271:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787836648.473279:0:15726:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787836648.473286:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787836648.473288:0:15726:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787836648.473305:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787836648.473319:0:15726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98e3c69f1a48) 00000020:00000080:2.0:1787836648.473341:0:15726:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787836648.473347:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787836648.473418:0:15726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e2c2db7800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787836648.473426:0:15726:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787836648.473433:0:15726:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x966835ea68ab871e 00010000:00010000:3.0:1787836648.477431:0:15726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787836648.477827:0:15726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787836648.479581:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787836648.481015:0:15726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787836648.481036:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836648.481044:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.481046:0:15726:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787836648.481049:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836648.481054:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.481055:0:15726:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787836648.481178:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787836648.481180:0:15726:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787836648.481183:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836648.481185:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.481187:0:15726:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787836648.481189:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836648.481192:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.481193:0:15726:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787836648.481196:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787836648.481259:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836648.481263:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.481264:0:15726:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787836648.481267:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787836648.481460:0:15724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787836648.481496:0:15724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787836648.481514:0:15724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8710 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836648.481525:0:15724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e401d3ea00/0x966835ea68ab8709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8710 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836648.481532:0:15724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e2c2db7800 from 1 10000000:01000000:2.0:1787836648.481535:0:15724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787836648.481570:0:15724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836648.481578:0:15724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836648.481599:0:15724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836648.481623:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787836648.481690:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.481726:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787836648.481793:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193219328 00000100:00100000:0.0:1787836648.481800:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193219328 00000100:00100000:0.0:1787836648.481945:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787836648.481954:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:15724:x1874682193219328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787836648.481967:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836648.481979:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab8725 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.482003:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab8725 expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.482013:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8725 expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.482022:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e401d3fe00, rc 0) 00000100:00100000:0.0:1787836648.482098:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219328:12345-0@lo:101:mount.lustre.0 Request processed in 144us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836648.482105:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787836648.482191:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787836648.482206:0:15724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836648.482215:0:15724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787836648.482690:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787836648.483110:0:15724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787836648.483400:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787836648.483445:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787836648.483504:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787836648.483513:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787836648.483579:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787836648.483639:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836648.483820:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e7d40900 going to sleep for 11 seconds 00000100:00100000:2.0:1787836648.483924:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193219456 00000100:00100000:2.0:1787836648.483933:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193219456 00000100:00100000:2.0:1787836648.483969:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787836648.483977:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836648.484195:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219456:12345-0@lo:501:mount.lustre.0 Request processed in 218us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.484203:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787836648.484918:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836648.484966:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787836648.485016:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.485054:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c5f5d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787836648.485103:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193219584 00000100:00100000:3.0:1787836648.485108:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193219584 00000100:00100000:3.0:1787836648.485145:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787836648.485153:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fb940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787836648.485329:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fb940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219584:12345-0@lo:503:mount.lustre.0 Request processed in 176us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836648.485336:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787836648.485416:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219584:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787836648.486412:0:15724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787836648.486482:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787836648.486532:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.486565:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c840ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836648.486664:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193219712 00000100:00100000:3.0:1787836648.486669:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193219712 00000100:00100000:3.0:1787836648.486707:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787836648.486715:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787836648.486968:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219712:12345-0@lo:502:mount.lustre.0 Request processed in 252us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836648.486976:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787836648.487343:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787836648.487629:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787836648.487821:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787836648.487951:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787836648.487985:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787836648.488014:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787836648.488055:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787836648.488115:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787836648.488148:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787836648.488186:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787836648.488252:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.488307:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c840ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836648.488330:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193219840 00000100:00100000:3.0:1787836648.488336:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193219840 00000100:00100000:3.0:1787836648.488389:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787836648.488405:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787836648.488623:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219840:12345-0@lo:502:mount.lustre.0 Request processed in 224us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836648.488631:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787836648.488778:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787836648.488972:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787836648.488985:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787836648.489933:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836648.489944:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.489946:0:15730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787836648.489953:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e2c2db7800 00000020:00000080:3.0:1787836648.489961:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787836648.489971:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836648.489974:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.489975:0:15730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787836648.489978:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836648.489981:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.489982:0:15730:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787836648.489985:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98e2c2db7800 00000020:00000080:3.0:1787836648.489987:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787836648.490038:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836648.490040:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.490041:0:15730:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787836648.490044:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787836648.490046:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.490048:0:15730:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787836648.490051:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98e2c2db7800 00000020:00000080:3.0:1787836648.490053:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787836648.490246:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787836648.490250:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787836648.490251:0:15730:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787836648.490254:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787836648.490391:0:15724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787836648.490413:0:15724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787836648.490467:0:15724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836648.490479:0:15724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836648.490522:0:15724:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787836648.490525:0:15724:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98e2c2db7800 10000000:01000000:2.0:1787836648.490529:0:15724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98e2c2db7800 10000000:01000000:2.0:1787836648.490533:0:15724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787836648.490539:0:15724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98e2c2db7800 from 1 10000000:01000000:2.0:1787836648.490541:0:15724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787836648.490579:0:15724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab8733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836648.490597:0:15724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab8733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836648.490608:0:15724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab8733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836648.490631:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787836648.490692:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.490731:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c840f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787836648.490803:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193219968 00000100:00100000:3.0:1787836648.490809:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193219968 00000100:00100000:3.0:1787836648.490928:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787836648.490939:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:15724:x1874682193219968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787836648.490952:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836648.490964:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c152a400/0x966835ea68ab873a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab8733 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836648.490987:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152a400/0x966835ea68ab873a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab8733 expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836648.491007:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c152a400/0x966835ea68ab873a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8733 expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836648.491016:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a400, rc 0) 00000100:00100000:3.0:1787836648.491053:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193219968:12345-0@lo:101:mount.lustre.0 Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836648.491130:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787836648.491212:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193219968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787836648.491228:0:15724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab8733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab873a expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836648.491237:0:15724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab8733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab873a expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787836648.491806:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787836648.493533:0:15724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787836648.496003:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787836648.496142:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787836648.496180:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787836648.496252:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787836648.496320:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787836648.496369:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787836648.496404:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787836648.496437:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787836648.496484:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787836648.496522:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787836648.496568:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787836648.496618:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787836648.496653:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787836648.496686:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787836648.496747:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787836648.496789:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787836648.496824:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787836648.497519:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787836648.497559:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787836648.497590:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787836648.497644:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787836648.497674:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787836648.497701:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787836648.497747:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787836648.497782:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787836648.497816:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787836648.498038:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787836648.498099:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787836648.498132:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787836648.498174:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787836648.498206:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787836648.498236:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787836648.498265:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787836648.498319:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787836648.498354:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787836648.498394:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787836648.498444:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787836648.498539:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787836648.498547:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787836648.498651:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193220096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836648.498713:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.499984:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c840f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787836648.500191:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193220096 00000100:00100000:1.0:1787836648.500203:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193220096 00000100:00100000:1.0:1787836648.500281:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787836648.500292:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193220096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787836648.500637:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193220096:12345-0@lo:501:mount.lustre.0 Request processed in 346us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836648.500646:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787836648.502052:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193220096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787836648.502122:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193220224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787836648.502183:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.502216:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193220224 00000100:00100000:2.0:1787836648.502221:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193220224 00000100:00100000:2.0:1787836648.502256:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787836648.502263:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193220224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787836648.502453:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193220224:12345-0@lo:503:mount.lustre.0 Request processed in 189us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.502459:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787836648.502502:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c840f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787836648.502513:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193220224:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787836648.504240:0:15724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787836648.504333:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193220352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787836648.504399:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836648.504442:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c840f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787836648.504533:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193220352 00000100:00100000:0.0:1787836648.504539:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193220352 00000100:00100000:0.0:1787836648.504576:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787836648.504594:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193220352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787836648.505346:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193220352:12345-0@lo:502:mount.lustre.0 Request processed in 752us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836648.505355:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787836648.505478:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193220352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787836648.506021:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787836648.506104:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787836648.506142:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787836648.506199:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787836648.506237:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787836648.506279:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787836648.506324:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787836648.506353:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787836648.506393:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787836648.506424:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787836648.506454:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787836648.506495:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787836648.506523:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787836648.506552:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787836648.506612:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787836648.506645:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787836648.506676:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787836648.506736:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787836648.507000:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787836648.507037:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787836648.507376:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787836648.507424:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787836648.507458:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787836648.507506:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787836648.507539:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787836648.507568:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787836648.507616:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787836648.507651:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787836648.507686:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787836648.507869:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787836648.507924:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787836648.507960:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787836648.507998:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787836648.508049:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787836648.508192:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787836648.508245:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787836648.508282:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787836648.508331:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787836648.508381:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787836648.508416:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787836648.508463:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193220480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787836648.508534:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836648.508608:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce009480 going to sleep for 11 seconds 00000100:00100000:2.0:1787836648.508648:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193220480 00000100:00100000:2.0:1787836648.508655:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193220480 00000100:00100000:2.0:1787836648.508851:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787836648.508862:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193220480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787836648.509094:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193220480:12345-0@lo:502:mount.lustre.0 Request processed in 233us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.509101:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787836648.509195:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193220480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787836648.509261:0:15724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787836648.509271:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787836648.511487:0:15735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787836648.511505:0:15735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98e3c69f4ed8) 00000020:00000080:2.0:1787836648.511530:0:15735:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787836648.511608:0:15735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98e2c2db7800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787836648.511612:0:15735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98e2c2db7800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787836648.511615:0:15735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98e2c2db7800 3 00010000:00080000:2.0:1787836648.511643:0:15735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98e3ee439000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1787836648.513766:0:15735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787836648.514995:0:15735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787836648.515037:0:15735:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787836648.515051:0:15735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x966835ea68ab8748 00000100:00080000:3.0:1787836648.515152:0:15735:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787836648.515167:0:15735:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98e3ee439000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1787836648.515205:0:15735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c378a1c0 x1874682193220608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787836648.515405:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874682193220608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787836648.515484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787836648.515558:0:15735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787836648.515611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787836648.515616:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787836648.515619:0:36:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787836648.515624:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:3.0:1787836648.515628:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787836648.515633:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e3ef7fd000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1787836648.515646:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e2c3789a40 x1874682193220864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787836648.515720:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193220608 00000100:00100000:2.0:1787836648.515732:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193220608 00000100:00100000:2.0:1787836648.515775:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836648.515784:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874682193220608:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787836648.515811:0:14324:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:2.0:1787836648.515877:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x966835ea68ab874f 00000004:00100000:2.0:1787836648.515897:0:14324:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787836648.515937:0:14324:0:(import.c:65:import_set_state_nolock()) ffff98e3ee438800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787836648.516254:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3789a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193220864:0@lo:8:kworker.0 00000100:00100000:0.0:1787836648.516291:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836648.516434:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c37892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193220736:0@lo:400:kworker.0 00000100:00100000:3.0:1787836648.516466:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836648.516528:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193220992:0@lo:400:kworker.0 00000100:00100000:3.0:1787836648.516558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836648.516576:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787836648.516581:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193221120:0@lo:400:kworker.0 00000100:00100000:3.0:1787836648.516600:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836648.516622:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787836648.516632:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787836648.517097:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874682193220608:12345-0@lo:38:llog_process_th.0 Request processed in 1310us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.517107:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836648.517130:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193220992 00000100:00100000:2.0:1787836648.517135:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193220992 00000100:00100000:2.0:1787836648.517159:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193221120 00000100:00100000:2.0:1787836648.517162:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193221120 00000100:00100000:2.0:1787836648.517182:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787836648.517189:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193220992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836648.517234:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874682193220992:12345-0@lo:400:kworker.0 Request processed in 45us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.517240:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787836648.517250:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787836648.517256:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193221120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836648.517282:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193221120:12345-0@lo:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.517303:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787836648.517326:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193220864 00000100:00100000:2.0:1787836648.517330:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193220864 00000100:00100000:2.0:1787836648.517347:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193220736 00000100:00100000:2.0:1787836648.517350:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193220736 00000100:00100000:2.0:1787836648.517369:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787836648.517375:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193220736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836648.517412:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193220736:12345-0@lo:400:kworker.0 Request processed in 38us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.517418:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787836648.517428:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787836648.517431:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874682193220864:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787836648.517484:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874682193220864:12345-0@lo:8:kworker.0 Request processed in 50us (1192us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787836648.517490:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787836648.517544:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787836648.517561:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c37892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193220736:0@lo:400:kworker.0 00010000:00080000:2.0:1787836648.517592:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c378b0c0 x1874682193221120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836648.517602:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193221120:0@lo:400:kworker.0 00010000:00080000:2.0:1787836648.517612:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c378ad00 x1874682193220992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836648.517619:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874682193220992:0@lo:400:kworker.0 00000100:00080000:3.0:1787836648.517789:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787836648.517793:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787836648.517917:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98e2c378a1c0 x1874682193220608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787836658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787836648.517926:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787836648.517931:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787836648.517939:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787836648.517943:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787836648.517946:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ee439000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787836648.517952:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874682193220608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787836648.517971:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787836648.517974:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787836648.517978:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787836648.517981:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3789a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193220864:0@lo:8:kworker.0 00000040:00080000:2.0:1787836648.518278:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787836648.518592:0:15724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787836648.518620:0:15724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787836648.518641:0:15724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab8733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab873a expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836648.518658:0:15724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005ba00/0x966835ea68ab8733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab873a expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787836648.518712:0:15724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787836648.518714:0:15724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787836648.518716:0:15724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836648.518717:0:15724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836648.518718:0:15724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836648.518720:0:15724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836648.518721:0:15724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787836648.518723:0:15724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836648.518724:0:15724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787836648.518728:0:15724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787836648.518730:0:15724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787836648.518732:0:15724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787836648.518733:0:15724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836648.518734:0:15724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836648.518735:0:15724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836648.518736:0:15724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836648.518737:0:15724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787836648.518738:0:15724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836648.518739:0:15724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787836648.518759:0:15724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787836648.518774:0:15724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193221248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787836648.518821:0:15724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836648.518978:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193221248 00000100:00100000:3.0:1787836648.518985:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193221248 00000100:00100000:3.0:1787836648.519014:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787836648.519021:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193221248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787836648.519045:0:14318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787836648.519080:0:14318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787836648.521256:0:15724:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce009180 going to sleep for 11 seconds 20000000:01000000:3.0:1787836648.547592:0:14318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787836648.547654:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787836648.547736:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787836648.547741:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787836648.547764:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.547793:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8629 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.547802:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.547852:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab8629 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.547867:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab8629 expref: 19 pid: 14318 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836648.547882:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc2940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1874682193221376:0@lo:104: 00000100:00100000:0.0:1787836648.547946:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836648.547995:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ef7d3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787836648.548083:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193221376 00000100:00100000:2.0:1787836648.548091:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193221376 00000100:00100000:2.0:1787836648.548146:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836648.548155:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:14339:x1874682193221376:12345-0@lo:104: 00010000:00010000:2.0:1787836648.548168:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836648.548220:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787836648.548227:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:14339:x1874682193221376:12345-0@lo:104: Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.548234:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787836648.548356:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc2940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1874682193221376:0@lo:104: 00010000:00010000:0.0:1787836648.548381:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.548618:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836648.548625:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.548633:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ee00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836648.548637:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.548645:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836648.548653:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836648.548658:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787836648.548696:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.548702:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836648.548731:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.548739:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e401d3ee00/0x966835ea68ab8629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab8630 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.548767:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836648.548769:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836648.548770:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836648.548777:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836648.548790:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3313:1874682193221504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836648.548822:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836648.548961:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193221504 00000100:00100000:1.0:1787836648.548967:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193221504 00010000:00010000:1.0:1787836648.548989:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8629 expref: 20 pid: 14318 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836648.549013:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787836648.549020:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+20:3313:x1874682193221504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787836648.549032:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836648.549037:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8629 expref: 20 pid: 14318 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549047:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab8629 expref: 20 pid: 14318 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549086:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3d005a200/0x966835ea68ab8630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab8629 expref: 20 pid: 14318 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549101:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549109:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787836648.549135:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003831559s 00010000:00010000:1.0:1787836648.549140:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549148:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549154:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549161:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549167:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836648.549171:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.549179:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.554257:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836648.554277:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836648.554460:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:15724:x1874682193221248:12345-0@lo:253:mount.lustre.0 Request processed in 35434us (35635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836648.554472:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1787836648.554604:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.554616:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e401d3e000/0x966835ea68ab8756 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836648.554636:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836648.554680:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:3313:x1874682193221504:12345-0@lo:103:ldlm_bl.0 Request processed in 5660us (5856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836648.554689:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836648.554790:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3313:1874682193221504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787836648.554913:0:15724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:54169f9e-8f3c-47d1-ba67-76dd190fcd61:15724:1874682193221248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787836648.554926:0:15724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787836648.554928:0:15724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787836648.554930:0:15724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787836648.554931:0:15724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787836648.554932:0:15724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787836648.554934:0:15724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787836648.554935:0:15724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787836648.554936:0:15724:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787836648.554938:0:15724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787836648.554940:0:15724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787836648.554953:0:15724:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787836648.561590:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787836648.562374:0:15724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787836648.562559:0:15724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787836648.562705:0:15724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787836648.562884:0:15724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787836648.563026:0:15724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787836648.563255:0:15724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787836648.564422:0:15724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787836648.623118:0:15724:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787836648.623128:0:15724:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787836648.623170:0:15724:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787836648.623246:0:15724:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787836648.623264:0:15724:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787836648.623303:0:15724:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1787836648.688714:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193221632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836648.688790:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836648.696249:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193221632 00000100:00100000:1.0:1787836648.696264:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193221632 00000100:00100000:1.0:1787836648.696456:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787836648.696471:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193221632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787836648.696530:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836648.696625:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193221632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (7834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836648.696632:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787836648.696709:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193221632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787836649.589284:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787836650.286391:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787836650.286398:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98e3fabd3000 from 8 10000000:01000000:2.0:1787836650.286403:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787836650.286446:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836650.286458:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836650.286470:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab875d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836650.286495:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193221760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787836650.286586:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836650.286647:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651300 going to sleep for 11 seconds 00000100:00100000:3.0:1787836650.286881:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193221760 00000100:00100000:3.0:1787836650.286890:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193221760 00000100:00100000:3.0:1787836650.286947:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787836650.286957:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:14321:x1874682193221760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836650.286972:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836650.286989:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c152b400/0x966835ea68ab8764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab875d expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836650.287013:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152b400/0x966835ea68ab8764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab875d expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836650.287033:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c152b400/0x966835ea68ab8764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab875d expref: 19 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836650.287043:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b400, rc 0) 00000100:00100000:3.0:1787836650.287120:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:14321:x1874682193221760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836650.287127:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787836650.288114:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193221760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836650.288136:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab875d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8764 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836650.288157:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab875d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab8764 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836650.288229:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193221888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787836650.288293:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836650.288330:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651300 going to sleep for 11 seconds 00000100:00100000:3.0:1787836650.288441:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193221888 00000100:00100000:3.0:1787836650.288447:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193221888 00000100:00100000:3.0:1787836650.288487:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787836650.288496:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:14321:x1874682193221888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787836650.288519:0:14318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787836650.288535:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787836650.288538:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787836650.288617:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:14321:x1874682193221888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836650.288624:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787836650.288816:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193221888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787836650.288894:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787836650.288901:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab875d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8764 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836650.288911:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005aa00/0x966835ea68ab875d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab8764 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836650.608276:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787836651.005528:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787836651.635256:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836652.657736:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836653.681294:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787836653.813008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787836653.813017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787836653.813021:0:36:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787836653.813035:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98e3ef7fd000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1787836653.813095:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98e3fadd1e00 x1874682193222272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787836653.813232:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193222016:0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.813316:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836653.813358:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193222656:0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.813386:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836653.813410:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787836653.813416:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193222144:0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.813454:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836653.813486:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193222400:0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.813509:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836653.813526:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787836653.813531:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193222528:0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.813552:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836653.813796:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193222016 00000100:00100000:2.0:1787836653.813805:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193222016 00000100:00100000:2.0:1787836653.813848:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787836653.813856:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3310:x1874682193222016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.813909:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3310:x1874682193222016:12345-0@lo:400:kworker.0 Request processed in 53us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836653.813917:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787836653.813947:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193222656 00000100:00100000:2.0:1787836653.813951:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193222656 00000100:00100000:2.0:1787836653.813988:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193222400 00000100:00100000:2.0:1787836653.813991:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193222400 00000100:00100000:2.0:1787836653.814002:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193222528 00000100:00100000:2.0:1787836653.814004:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193222528 00000100:00100000:2.0:1787836653.814019:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787836653.814025:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193222656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.814080:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193222656:12345-0@lo:400:kworker.0 Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836653.814087:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787836653.814100:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787836653.814105:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193222400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.814137:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193222400:12345-0@lo:400:kworker.0 Request processed in 32us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836653.814152:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787836653.814164:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787836653.814170:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193222528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.814198:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193222528:12345-0@lo:400:kworker.0 Request processed in 28us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836653.814204:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787836653.814221:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193222144 00000100:00100000:2.0:1787836653.814224:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193222144 00000100:00100000:2.0:1787836653.814249:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787836653.814255:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193222144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.814299:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193222144:12345-0@lo:400:kworker.0 Request processed in 44us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836653.814304:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787836653.814347:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fadd30c0 x1874682193222528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836653.814359:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193222528:0@lo:400:kworker.0 00010000:00080000:2.0:1787836653.814370:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fadd0f00 x1874682193222400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836653.814378:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193222400:0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.814407:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193222144:0@lo:400:kworker.0 00000100:00100000:2.0:1787836653.814415:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193222016:0@lo:400:kworker.0 00010000:00080000:2.0:1787836653.814424:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fadd2580 x1874682193222656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836653.814444:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193222656:0@lo:400:kworker.0 00000100:00080000:3.0:1787836653.815906:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787836653.815914:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787836653.817437:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193222272:0@lo:8:kworker.0 00000100:00100000:0.0:1787836653.817527:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836653.817809:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836653.817821:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193222784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836653.818012:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836653.818075:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193222784 00000100:00100000:0.0:1787836653.818083:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193222784 00000100:00100000:0.0:1787836653.818131:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787836653.818139:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193222784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836653.818173:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836653.818231:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193222784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836653.818240:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787836653.818300:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193222784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836653.820321:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193222272 00000100:00100000:2.0:1787836653.820333:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193222272 00000100:00100000:2.0:1787836653.820376:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787836653.820383:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874682193222272:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787836653.820416:0:15007:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1787836653.820450:0:15007:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x966835ea68ab876b 00002000:00100000:2.0:1787836653.820467:0:15007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98e3ee43a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113961 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787836653.820472:0:15007:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787836653.820475:0:15007:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787836653.822478:0:15007:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787836653.822519:0:15007:0:(import.c:65:import_set_state_nolock()) ffff98e3ee43d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787836653.822601:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874682193222272:12345-0@lo:8:kworker.0 Request processed in 2217us (5073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836653.822611:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787836653.827336:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fadd1e00 x1874682193222272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787836678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787836653.827357:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787836653.827366:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787836653.827371:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787836653.827374:0:3309:0:(import.c:65:import_set_state_nolock()) ffff98e3ef7fd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787836653.827506:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787836653.827513:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874682193222272:0@lo:8:kworker.0 00000004:00080000:2.0:1787836653.827545:0:14347:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787836653.827787:0:14348:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787836653.827814:0:14348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1874682193223040:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787836653.829307:0:14348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836653.829347:0:14348:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ef7d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836653.830179:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193223040 00000100:00100000:1.0:1787836653.830190:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193223040 00000100:00100000:1.0:1787836653.830267:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787836653.830291:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14348:x1874682193223040:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1787836653.833295:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787836653.835123:0:14347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 502268061673ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787836653.835169:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787836653.835191:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193222912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836653.835269:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836653.835326:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193222912 00000100:00100000:2.0:1787836653.835333:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193222912 00000100:00100000:2.0:1787836653.835373:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836653.835382:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874682193222912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836653.835413:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836653.835456:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874682193222912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836653.835464:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787836653.835504:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3fadc0f00 x1874682193222912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787836669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787836653.835524:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193222912:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1787836653.859521:0:15009:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787836653.859537:0:15009:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787836653.859543:0:15009:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1787836653.889571:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.889584:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.889602:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.889608:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.890910:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.890941:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.890962:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.890971:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.891020:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787836653.895380:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836653.895395:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.895408:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ec00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.895412:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.895424:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.895451:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.895459:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8772 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.895485:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.895487:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.895489:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.899015:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.899029:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.899046:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.899051:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.899075:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.899091:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.899102:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.899110:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.899145:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836653.900088:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836653.900098:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.900108:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836653.900113:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.900136:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.900156:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.900163:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab8779 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.900183:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836653.900185:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836653.900187:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.900399:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.900418:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.900429:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.900433:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.900439:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.900451:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.900458:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.900467:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.900489:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787836653.901223:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836653.901233:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.901243:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836653.901248:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.901266:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.901283:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.901308:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab8780 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.901328:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836653.901330:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836653.901331:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.902119:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.902128:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.902143:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.902155:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.902162:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.902175:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.902185:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.902193:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.902272:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787836653.903247:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.903265:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.903277:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.903280:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.903285:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.903296:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.903305:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.903320:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907240:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836653.907265:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907294:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.907299:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907311:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907333:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907342:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab8787 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907365:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836653.907369:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907375:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.907379:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907386:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907394:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.907406:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.907408:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.907410:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.912491:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787836653.912506:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab878e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.913097:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.915581:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.915598:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918198:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.918206:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.918217:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918238:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918251:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918268:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918326:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.918341:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.918348:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918356:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.918361:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918371:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918389:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918396:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab8795 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.918419:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.918421:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.918423:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.922721:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.922733:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.922750:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.922760:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.922767:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.922782:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.922792:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.922799:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.922836:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787836653.924651:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836653.924663:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.924676:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.924681:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.924691:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.924709:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.924717:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab879c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.924737:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.924739:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.924741:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787836653.929542:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787836653.930034:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.930046:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930091:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.930096:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.930104:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930120:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930132:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930150:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930168:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.930181:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.930186:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930194:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.930199:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930208:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930224:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930231:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.930247:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.930248:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.930250:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.934484:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.934511:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.934531:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.934536:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.934543:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.934558:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.934568:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.934576:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.937332:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787836653.938189:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.938203:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.938225:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.938230:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.938239:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.938267:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.938285:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.938292:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939402:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787836653.939414:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939425:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836653.939429:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939438:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939471:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939478:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939504:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836653.939509:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939516:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ee00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836653.939519:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939526:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939536:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836653.939542:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836653.939543:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836653.939545:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.941761:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787836653.941776:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.941821:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.944526:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.944538:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.944554:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.944558:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.944564:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.944578:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.944588:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.944607:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.949784:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.949804:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.949813:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.949826:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.949830:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.950019:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.950044:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.950052:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.950098:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.950100:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.950102:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.953363:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.953389:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.953409:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.953414:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.953421:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.953436:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.953447:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.953457:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.953485:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787836653.954281:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836653.954289:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.954316:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ee00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.954321:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.954331:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.954351:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.954359:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab87bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.954381:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.954383:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.954385:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.958453:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.958474:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.958496:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.958502:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.958511:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.958529:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.958551:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.958559:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.958586:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787836653.959369:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.959379:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.959392:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.959396:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.959402:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.959413:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.959421:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.959428:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.959455:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787836653.960351:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.960359:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.960373:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.960376:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.960382:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.960392:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.960400:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.960407:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.960415:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787836653.960749:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787836653.960758:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960767:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.960772:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960782:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960809:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960817:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e11f9103/0x966835ea68ab87c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960861:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836653.960866:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960872:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.960875:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960882:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960891:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960898:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb666046/0x966835ea68ab87cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960910:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836653.960913:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960927:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.960931:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960937:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960946:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960953:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009830869b/0x966835ea68ab87d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.960965:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.960966:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.960968:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.960975:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.961507:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.961514:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.961524:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.961533:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.961540:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.961551:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.961560:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.961569:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.961587:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787836653.961715:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836653.961720:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.961727:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e800 already unused, calling callback (ffffffffc1594500) 00010000:00010000:1.0:1787836653.961730:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.961748:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.961760:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.961767:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000249d5768/0x966835ea68ab87db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836653.961781:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.961783:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836653.961784:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.962607:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.963052:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963095:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.963099:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.963105:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963119:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963128:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963144:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963163:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787836653.963609:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.963627:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963635:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.963638:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.963643:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963652:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963659:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963666:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963684:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787836653.963696:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787836653.963701:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963714:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.963718:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963727:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963741:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963748:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab87e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963764:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.963767:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963773:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.963776:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963783:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963791:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963804:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab87e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.963818:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.963820:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.963821:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.964386:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.964393:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964404:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.964407:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.964412:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964422:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964430:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964437:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964449:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.964456:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.964464:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964471:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f000 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.964475:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964483:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964494:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964501:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000249e4eb0/0x966835ea68ab87f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.964513:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.964515:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.964516:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836653.965174:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.965303:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.965310:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965322:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.965325:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.965330:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965351:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965360:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965367:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965381:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.965388:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.965392:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965398:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.965402:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965410:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965422:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965428:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdb637a0/0x966835ea68ab87f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.965448:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.965449:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.965451:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.966364:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.966372:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.966385:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.966388:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.966394:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.966404:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.966412:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.966419:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.966483:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787836653.968573:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.968587:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.968621:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.968626:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.968633:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.968648:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.968657:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.968664:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971751:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787836653.971766:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971782:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836653.971788:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971799:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971822:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971839:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900809f/0x966835ea68ab87fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971883:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787836653.971888:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971907:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ec00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:3.0:1787836653.971911:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971918:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971928:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836653.971936:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836653.971938:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836653.971940:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.972783:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787836653.972794:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019e91395/0x966835ea68ab8805 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.972840:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.973602:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.973610:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.973638:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.973643:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.973651:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.973674:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.973684:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.973692:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.973712:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787836653.974176:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.974182:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974191:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.974194:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.974198:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974207:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974215:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974233:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974249:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787836653.974274:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787836653.974279:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974287:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3f200 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.974291:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974299:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974315:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974323:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9dca299/0x966835ea68ab880c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974339:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.974342:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974359:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3e600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.974362:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974370:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974381:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974388:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aaefdcf/0x966835ea68ab8813 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974400:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.974402:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.974404:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.974802:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.974808:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974816:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.974818:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.974822:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974830:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974844:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974850:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974862:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.974871:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.974874:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974881:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3ee00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.974884:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974891:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974902:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974910:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb13803f/0x966835ea68ab881a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.974923:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.974930:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.974932:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.975373:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.975379:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975388:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.975392:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.975396:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975405:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975414:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975421:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975435:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.975444:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.975447:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975453:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031c00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.975457:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975475:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975487:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975494:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000015f38a/0x966835ea68ab8821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975510:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.975512:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.975513:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.975949:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.975956:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975966:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.975970:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.975975:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975984:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.975991:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.976008:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.976025:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.976036:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.976040:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.976047:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031400 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.976051:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.976092:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.976105:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.976114:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053f4841c/0x966835ea68ab8828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.976128:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.976130:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.976131:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836653.976442:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787836653.980537:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787836653.980557:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.980574:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1787836653.980578:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836653.980585:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.980598:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.980608:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.981265:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.981286:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787836653.981298:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836653.981304:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.981312:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836653.981317:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.981328:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.981352:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.981360:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1f44e8/0x966835ea68ab882f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836653.981379:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.981380:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836653.981382:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787836653.981606:0:15009:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787836653.981706:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14348:x1874682193223040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 151415us (152401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836653.981716:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836653.981768:0:14348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1874682193223040:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787836653.981783:0:14348:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787836653.981822:0:14348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1874682193223168:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787836653.981989:0:14348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836653.982030:0:14348:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d06d1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787836653.982046:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193223168 00000100:00100000:0.0:1787836653.982051:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193223168 00000100:00100000:0.0:1787836653.982104:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787836653.982111:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14348:x1874682193223168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787836653.982143:0:15007:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787836654.017245:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14348:x1874682193223168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 35126us (35248us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787836654.017276:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787836654.017750:0:14348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1874682193223168:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787836654.017765:0:14348:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787836654.706750:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836655.736729:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787836656.105943:0:16082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787836656.753328:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836657.774625:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836658.779662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836658.779754:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172253568 00000100:00100000:2.0:1787836658.779775:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172253568 00000100:00100000:2.0:1787836658.779824:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:2.0:1787836658.779851:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1874682172253568:12345-192.168.203.25@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787836658.779882:0:14319:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 303db8d1-2e8f-4f4f-8104-a67bc8426709@192.168.203.25@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1787836658.779918:0:14319:0:(genops.c:1385:class_connect()) connect: client 303db8d1-2e8f-4f4f-8104-a67bc8426709, cookie 0x966835ea68ab8836 00000100:00080000:2.0:1787836658.780099:0:14319:0:(import.c:65:import_set_state_nolock()) ffff98e3ee43b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787836658.780157:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+5:2360:x1874682172253568:12345-192.168.203.25@tcp:250:mount.lustre.0 Request processed in 307us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836658.780166:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:2.0:1787836658.793648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836658.797006:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172253696 00000100:00100000:3.0:1787836658.797021:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172253696 00010000:00010000:3.0:1787836658.799490:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836658.800604:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:2.0:1787836658.800619:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+5:13756:x1874682172253696:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787836658.800640:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836658.800660:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005a200/0x966835ea68ab883d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee246 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836658.800691:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005a200/0x966835ea68ab883d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee246 expref: 6 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836658.800703:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005a200/0x966835ea68ab883d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee246 expref: 6 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836658.800713:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005a200, rc 0) 00000100:00100000:2.0:1787836658.800952:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+6:13756:x1874682172253696:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 335us (7382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836658.800960:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:1.0:1787836658.815447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836658.815563:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172253824 00000100:00100000:0.0:1787836658.815573:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172253824 00000100:00100000:0.0:1787836658.815626:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:0.0:1787836658.815635:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+6:13756:x1874682172253824:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787836658.816323:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+6:13756:x1874682172253824:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 686us (882us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787836658.816334:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:0.0:1787836658.832263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836658.832360:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172253952 00000100:00100000:2.0:1787836658.832381:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172253952 00000100:00100000:2.0:1787836658.832449:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:2.0:1787836658.832459:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+6:13756:x1874682172253952:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787836658.832476:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836658.832492:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005b800/0x966835ea68ab8844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee24d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836658.832530:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005b800/0x966835ea68ab8844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee24d expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836658.832542:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005b800/0x966835ea68ab8844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee24d expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836658.832560:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005b800, rc 0) 00000100:00100000:2.0:1787836658.832625:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+7:13756:x1874682172253952:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 168us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836658.832633:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 78 00000100:00100000:0.0:1787836658.834773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836658.834858:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172254080 00000100:00100000:3.0:1787836658.834868:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172254080 00000100:00100000:3.0:1787836658.834920:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:3.0:1787836658.834929:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+7:13756:x1874682172254080:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787836658.835258:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+8:13756:x1874682172254080:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 330us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836658.835277:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 79 00000100:00100000:1.0:1787836658.840205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836658.840306:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172254208 00000100:00100000:0.0:1787836658.840315:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172254208 00000100:00100000:0.0:1787836658.840423:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:0.0:1787836658.840433:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+8:13756:x1874682172254208:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787836658.840953:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+8:13756:x1874682172254208:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 332us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836658.840963:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:0.0:1787836658.849146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836658.849258:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172254336 00000100:00100000:2.0:1787836658.849268:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172254336 00000100:00100000:2.0:1787836658.849319:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:2.0:1787836658.849328:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+8:13775:x1874682172254336:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787836658.849857:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+8:13775:x1874682172254336:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 528us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836658.849865:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:2.0:1787836658.881315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836658.887843:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172254464 00000100:00100000:0.0:1787836658.887858:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172254464 00000100:00100000:0.0:1787836658.887936:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:0.0:1787836658.887945:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+8:13775:x1874682172254464:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787836658.888241:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+8:13775:x1874682172254464:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 295us (6934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836658.888256:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:1.0:1787836658.897055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836658.898183:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172254592 00000100:00100000:3.0:1787836658.898263:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172254592 00000100:00100000:3.0:1787836658.898585:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:3.0:1787836658.898598:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+8:13756:x1874682172254592:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787836658.898614:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836658.898630:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c152a000/0x966835ea68ab884b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee277 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836658.898657:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152a000/0x966835ea68ab884b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee277 expref: 9 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836658.898668:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c152a000/0x966835ea68ab884b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee277 expref: 9 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836658.898677:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152a000, rc 0) 00000100:00100000:3.0:1787836658.898742:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+9:13756:x1874682172254592:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 147us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836658.910846:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:1.0:1787836658.912604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836658.913138:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172254720 00000100:00100000:3.0:1787836658.913149:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172254720 00000100:00100000:3.0:1787836658.913214:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:3.0:1787836658.913232:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+9:13756:x1874682172254720:12345-192.168.203.25@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787836658.913260:0:14318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787836658.913283:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787836658.913287:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787836658.913290:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787836658.913297:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787836658.916552:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+9:13756:x1874682172254720:12345-192.168.203.25@tcp:256:mount.lustre.0 Request processed in 3314us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836658.916568:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 84 00000100:00100000:3.0:1787836658.926603:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193223680:0@lo:400:kworker.0 00000100:00100000:3.0:1787836658.926684:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836658.926749:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787836658.926755:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193223296:0@lo:400:kworker.0 00000100:00100000:3.0:1787836658.926925:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836658.927029:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836658.927041:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193224192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836658.927093:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193223424:0@lo:400:kworker.0 00000100:00100000:1.0:1787836658.927105:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836658.927139:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836658.927158:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193224192 00000100:00100000:1.0:1787836658.927167:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193224192 00000100:00100000:0.0:1787836658.927170:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193223936:0@lo:400:kworker.0 00000100:00100000:0.0:1787836658.927208:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836658.927241:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787836658.927247:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193223552:0@lo:400:kworker.0 00000100:00100000:0.0:1787836658.927270:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836658.927288:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3fadc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193224064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836658.927314:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836658.927364:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193224064 00000100:00100000:1.0:1787836658.927369:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193224064 00000100:00100000:1.0:1787836658.927391:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836658.927402:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874682193224192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787836658.927447:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836658.927506:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874682193224192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836658.927514:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836658.927537:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836658.927546:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193224064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787836658.927565:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836658.927603:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193224064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836658.927610:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836658.927631:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193223424 00000100:00100000:1.0:1787836658.927635:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193223424 00000100:00100000:1.0:1787836658.927662:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193223552 00000100:00100000:1.0:1787836658.927665:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193223552 00000100:00100000:1.0:1787836658.927716:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787836658.927724:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193223424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836658.927730:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193223680 00000100:00100000:0.0:1787836658.927735:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193223680 00000100:00100000:1.0:1787836658.927766:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193223424:12345-0@lo:400:kworker.0 Request processed in 43us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836658.927774:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787836658.927783:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193223936 00000100:00100000:0.0:1787836658.927787:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193223936 00000100:00100000:1.0:1787836658.927791:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787836658.927811:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836658.927815:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193223552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836658.927824:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193223680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836658.927851:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874682193223552:12345-0@lo:400:kworker.0 Request processed in 51us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836658.927868:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193223680:12345-0@lo:400:kworker.0 Request processed in 46us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836658.927875:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787836658.927886:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787836658.927891:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193223936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836658.927912:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193223936:12345-0@lo:400:kworker.0 Request processed in 21us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836658.927917:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787836658.927930:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787836658.927940:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787836658.927942:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836658.931461:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787836658.936166:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193223296 00000100:00100000:2.0:1787836658.936181:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193223296 00000100:00100000:0.0:1787836658.939335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836658.941656:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193223808:0@lo:400:kworker.0 00000100:00100000:3.0:1787836658.941741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787836658.941813:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604c3c0 x1874682193223680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836658.941827:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193223680:0@lo:400:kworker.0 00000100:00100000:3.0:1787836658.941920:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172254848 00000100:00100000:3.0:1787836658.941926:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172254848 00000100:00100000:3.0:1787836658.941946:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787836658.941954:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3312:x1874682193223296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836658.943295:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3312:x1874682193223296:12345-0@lo:400:kworker.0 Request processed in 1332us (16362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836658.943309:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787836658.943363:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 86 00000100:00100000:3.0:1787836658.943670:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+9:13756:x1874682172254848:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787836658.943687:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836658.943706:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee27e expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836658.943750:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836658.943760:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836658.943936:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193223808 00000100:00100000:0.0:1787836658.943944:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193223808 00000100:00100000:0.0:1787836658.944104:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787836658.944113:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193223808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836658.944195:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193223808:12345-0@lo:400:kworker.0 Request processed in 83us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836658.944201:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787836658.944231:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787836658.944308:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b600, rc 0) 00000100:00100000:3.0:1787836658.944662:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13756:x1874682172254848:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 997us (5334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836658.944669:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 86 00000100:00100000:3.0:1787836658.944720:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193223296:0@lo:400:kworker.0 00010000:00080000:3.0:1787836658.944738:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604c000 x1874682193223808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787836658.944749:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193223808:0@lo:400:kworker.0 00000100:00100000:1.0:1787836658.950987:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193224192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787836658.951045:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193223552:0@lo:400:kworker.0 00000100:00100000:1.0:1787836658.951083:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3fadc1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193224064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787836658.951913:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193223424:0@lo:400:kworker.0 00010000:00080000:1.0:1787836658.951950:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98e3c604cf00 x1874682193223936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787836674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787836658.951963:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193223936:0@lo:400:kworker.0 00000100:00100000:3.0:1787836658.954155:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836658.954188:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172254976 00000100:00100000:3.0:1787836658.954196:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172254976 00000100:00100000:3.0:1787836658.954252:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:3.0:1787836658.954262:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13756:x1874682172254976:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787836658.954532:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13756:x1874682172254976:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 271us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836658.954541:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 87 00000100:00100000:0.0:1787836658.963902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836658.963948:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172255104 00000100:00100000:0.0:1787836658.963962:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172255104 00000100:00100000:0.0:1787836658.964023:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:0.0:1787836658.964035:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13756:x1874682172255104:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787836658.964791:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13756:x1874682172255104:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 756us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836658.964801:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 88 00000100:00100000:0.0:1787836658.971738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836658.972184:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172255232 00000100:00100000:1.0:1787836658.972195:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172255232 00000100:00100000:1.0:1787836658.972260:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 89 00000100:00100000:1.0:1787836658.972271:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13779:x1874682172255232:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787836658.972580:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13779:x1874682172255232:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 309us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836658.973486:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 89 00000100:00100000:0.0:1787836658.983657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836658.987599:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172255360 00000100:00100000:3.0:1787836658.987618:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172255360 00000100:00100000:2.0:1787836658.988195:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:2.0:1787836658.988207:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13779:x1874682172255360:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787836658.988696:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13779:x1874682172255360:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 490us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836658.988705:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:1.0:1787836659.002179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836659.002546:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172255488 00000100:00100000:2.0:1787836659.002557:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172255488 00000100:00100000:2.0:1787836659.002617:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:2.0:1787836659.002627:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1874682172255488:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787836659.002659:0:15736:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from e9b6c886-a12b-46a3-a789-dc548bbc30a4@192.168.203.25@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1787836659.002709:0:15736:0:(genops.c:1385:class_connect()) connect: client e9b6c886-a12b-46a3-a789-dc548bbc30a4, cookie 0x966835ea68ab8859 00000004:00100000:2.0:1787836659.002737:0:15736:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1787836659.002744:0:15736:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787836659.050503:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787836659.050557:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1787836659.058198:0:15736:0:(import.c:65:import_set_state_nolock()) ffff98e3f5ae1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787836659.058898:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2360:x1874682172255488:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 56266us (56731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836659.058911:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:3.0:1787836659.061711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836659.063616:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172255616 00000100:00100000:0.0:1787836659.063630:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172255616 00000100:00100000:0.0:1787836659.063722:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1787836659.063733:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:0:x1874682172255616:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787836659.063786:0:14325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787836659.063883:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:0:x1874682172255616:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 151us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836659.063894:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836659.063909:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1787836659.063927:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172255744 00000100:00100000:0.0:1787836659.063932:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172255744 00000100:00100000:0.0:1787836659.063956:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:0.0:1787836659.063961:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13756:x1874682172255744:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787836659.063973:0:14325:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787836659.063997:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13756:x1874682172255744:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836659.064004:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00080000:2.0:1787836659.064092:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836659.067099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836659.067344:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172255872 00000100:00100000:0.0:1787836659.067354:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172255872 00000100:00100000:0.0:1787836659.067564:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:0.0:1787836659.067577:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13756:x1874682172255872:12345-192.168.203.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787836659.067681:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13756:x1874682172255872:12345-192.168.203.25@tcp:40:mount.lustre.0 Request processed in 106us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836659.067688:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:0.0:1787836659.075261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836659.075357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836659.075461:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836659.075538:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172256256 00000100:00100000:1.0:1787836659.075549:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172256256 00000100:00100000:1.0:1787836659.075610:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1787836659.075621:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13756:x1874682172256256:12345-192.168.203.25@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787836659.075712:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172256000 00000100:00100000:2.0:1787836659.075718:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172256000 00000100:00100000:2.0:1787836659.075744:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172256128 00000100:00100000:2.0:1787836659.075748:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172256128 00000100:00100000:1.0:1787836659.075760:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1787836659.075781:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874682172256000:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787836659.075826:0:15008:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from e9b6c886-a12b-46a3-a789-dc548bbc30a4@192.168.203.25@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:1.0:1787836659.075860:0:15008:0:(genops.c:1385:class_connect()) connect: client e9b6c886-a12b-46a3-a789-dc548bbc30a4, cookie 0x966835ea68ab8860 00002000:00100000:1.0:1787836659.075872:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e9b6c886-a12b-46a3-a789-dc548bbc30a4/ffff98e3ffdbd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787836659.075885:0:15008:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000004:00080000:0.0:1787836659.076436:0:14326:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 732us 00002000:00080000:1.0:1787836659.078170:0:15008:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787836659.078213:0:15008:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdbd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836659.078304:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2360:x1874682172256000:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 2521us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836659.078315:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1787836659.078346:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:1.0:1787836659.078352:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d2181680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874682172256128:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787836659.078378:0:15008:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from e9b6c886-a12b-46a3-a789-dc548bbc30a4@192.168.203.25@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:1.0:1787836659.078412:0:15008:0:(genops.c:1385:class_connect()) connect: client e9b6c886-a12b-46a3-a789-dc548bbc30a4, cookie 0x966835ea68ab8867 00002000:00100000:1.0:1787836659.078431:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e9b6c886-a12b-46a3-a789-dc548bbc30a4/ffff98e3ffdb8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787836659.078443:0:15008:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787836659.078752:0:15008:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787836659.078771:0:15008:0:(import.c:65:import_set_state_nolock()) ffff98e3ffdbf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836659.078800:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d2181680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2360:x1874682172256128:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 446us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836659.078806:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000004:00200000:0.0:1787836659.087994:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787836659.088198:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13756:x1874682172256256:12345-192.168.203.25@tcp:33:mount.lustre.0 Request processed in 12573us (12939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836659.088213:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:0.0:1787836659.287428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836659.287551:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172256384 00000100:00100000:1.0:1787836659.287561:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172256384 00000100:00100000:1.0:1787836659.287647:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1787836659.287669:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d2180b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13800:x1874682172256384:12345-192.168.203.25@tcp:101:mkdir.0 00010000:00010000:1.0:1787836659.287698:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836659.287729:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab886e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee2a8 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836659.287807:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8875 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836659.287822:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836659.287838:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836659.288120:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787836659.288127:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836659.288263:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836659.288294:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4000/0x966835ea68ab886e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2a8 expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836659.288315:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2a8 expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836659.288323:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:1.0:1787836659.288327:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836659.288331:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5a00, rc 0) 00000100:00100000:1.0:1787836659.288420:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d2180b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:13800:x1874682172256384:12345-192.168.203.25@tcp:101:mkdir.0 Request processed in 755us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836659.288438:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00010000:00010000:1.0:1787836659.825236:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836660.846324:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787836661.230887:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787836661.418496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836661.418944:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172256512 00000100:00100000:2.0:1787836661.418954:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172256512 00000100:00100000:2.0:1787836661.419029:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1787836661.419041:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:13853:x1874682172256512:12345-192.168.203.25@tcp:41:lfs.0 00000004:00000024:2.0:1787836661.419559:0:15736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1787836661.419753:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836661.420506:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:13853:x1874682172256512:12345-192.168.203.25@tcp:41:lfs.0 Request processed in 1460us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836661.420517:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1787836661.431595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836661.431698:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172256640 00000100:00100000:3.0:1787836661.431710:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172256640 00000100:00100000:3.0:1787836661.431784:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:3.0:1787836661.431802:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13853:x1874682172256640:12345-192.168.203.25@tcp:13:lfs.0 00002000:00000024:3.0:1787836661.431837:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836661.431911:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13853:x1874682172256640:12345-192.168.203.25@tcp:13:lfs.0 Request processed in 119us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836661.431920:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00080000:0.0:1787836661.432081:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787836661.441521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836661.441707:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172256768 00000100:00100000:1.0:1787836661.441720:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172256768 00000100:00100000:1.0:1787836661.441807:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1787836661.441818:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13853:x1874682172256768:12345-192.168.203.25@tcp:13:lfs.0 00002000:00000024:1.0:1787836661.441854:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836661.441950:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:13853:x1874682172256768:12345-192.168.203.25@tcp:13:lfs.0 Request processed in 134us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836661.441957:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00080000:0.0:1787836661.443007:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787836661.835158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836661.835550:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172256896 00000100:00100000:1.0:1787836661.835560:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172256896 00000100:00100000:1.0:1787836661.835633:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:1.0:1787836661.835643:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+10:13887:x1874682172256896:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787836661.835662:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836661.835679:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f4000/0x966835ea68ab887c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee2af expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836661.835710:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f4000/0x966835ea68ab887c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2af expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836661.835721:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f4000/0x966835ea68ab887c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2af expref: 11 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836661.835730:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4000, rc 0) 00000100:00100000:1.0:1787836661.836257:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13887:x1874682172256896:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 612us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836661.836293:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:3.0:1787836661.857640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836661.857802:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172257024 00000100:00100000:2.0:1787836661.857812:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172257024 00000100:00100000:2.0:1787836661.857961:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:2.0:1787836661.857971:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c1d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13887:x1874682172257024:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787836661.859688:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c1d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13887:x1874682172257024:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 1709us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836661.859699:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 92 00000100:00100000:3.0:1787836661.869983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00010000:00010000:0.0:1787836661.871552:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836661.875502:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172257152 00000100:00100000:1.0:1787836661.875519:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172257152 00000100:00100000:1.0:1787836661.875667:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:1.0:1787836661.875679:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13887:x1874682172257152:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787836661.876053:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13887:x1874682172257152:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 375us (7268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836661.876082:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 93 00000100:00100000:3.0:1787836661.890969:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836661.891841:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172257280 00000100:00100000:0.0:1787836661.891852:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172257280 00000100:00100000:0.0:1787836661.891900:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 94 00000100:00100000:0.0:1787836661.891909:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13892:x1874682172257280:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787836661.892226:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13892:x1874682172257280:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 317us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836661.892234:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 94 00000100:00100000:3.0:1787836661.931912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836661.943725:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172257408 00000100:00100000:0.0:1787836661.943740:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172257408 00000100:00100000:0.0:1787836661.943970:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 95 00000100:00100000:0.0:1787836661.943983:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13892:x1874682172257408:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787836661.944308:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13892:x1874682172257408:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 327us (12405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836661.944316:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 95 00000100:00100000:1.0:1787836661.953678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836661.964929:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172257536 00000100:00100000:2.0:1787836661.964944:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172257536 00000100:00100000:2.0:1787836661.965544:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 96 00000100:00100000:2.0:1787836661.965557:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13887:x1874682172257536:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787836661.965573:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836661.965714:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005be00/0x966835ea68ab8883 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee2d9 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836661.965743:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005be00/0x966835ea68ab8883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2d9 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836661.965753:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005be00/0x966835ea68ab8883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2d9 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836661.965761:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005be00, rc 0) 00000100:00100000:2.0:1787836661.966291:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13887:x1874682172257536:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 735us (12621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836661.966316:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 96 00000100:00100000:0.0:1787836661.984019:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836661.985033:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172257664 00000100:00100000:1.0:1787836661.985045:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172257664 00000100:00100000:1.0:1787836661.985145:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:1.0:1787836661.985155:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13887:x1874682172257664:12345-192.168.203.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787836661.985188:0:14318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787836661.985221:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787836661.985225:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787836661.985229:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787836661.985231:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787836661.989414:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13887:x1874682172257664:12345-192.168.203.25@tcp:256:mount.lustre.0 Request processed in 4234us (5380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836661.989436:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 97 00000100:00100000:3.0:1787836662.005824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836662.006047:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172257792 00000100:00100000:1.0:1787836662.006094:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172257792 00000100:00100000:1.0:1787836662.006155:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00100000:1.0:1787836662.006165:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13887:x1874682172257792:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787836662.006207:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836662.006226:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee2e0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.006253:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.006265:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 13 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.006274:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5400, rc 0) 00000100:00100000:1.0:1787836662.006328:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13887:x1874682172257792:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 165us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836662.006336:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 98 00000100:00100000:2.0:1787836662.013003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836662.013105:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172257920 00000100:00100000:1.0:1787836662.013115:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172257920 00000100:00100000:1.0:1787836662.013174:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00100000:1.0:1787836662.013184:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13887:x1874682172257920:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787836662.013622:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13887:x1874682172257920:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 438us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836662.013632:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 99 00000100:00100000:2.0:1787836662.031774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836662.031877:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172258048 00000100:00100000:0.0:1787836662.031887:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172258048 00000100:00100000:0.0:1787836662.031953:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00100000:0.0:1787836662.031963:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13887:x1874682172258048:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787836662.032255:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13887:x1874682172258048:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 292us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836662.032282:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 100 00000100:00100000:2.0:1787836662.035848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836662.036010:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172258176 00000100:00100000:1.0:1787836662.036022:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172258176 00000100:00100000:1.0:1787836662.036109:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00100000:1.0:1787836662.036120:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13896:x1874682172258176:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787836662.036375:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13896:x1874682172258176:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 257us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836662.036404:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 101 00000100:00100000:2.0:1787836662.051239:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836662.051416:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172258304 00000100:00100000:1.0:1787836662.051428:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172258304 00000100:00100000:1.0:1787836662.051490:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00100000:1.0:1787836662.051501:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13896:x1874682172258304:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787836662.052162:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13896:x1874682172258304:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 659us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836662.052172:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 102 00000100:00100000:2.0:1787836662.057095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836662.057136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836662.057221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836662.057409:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172258816 00000100:00100000:0.0:1787836662.057421:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172258816 00000100:00100000:0.0:1787836662.057483:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172258688 00000100:00100000:0.0:1787836662.057487:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172258688 00000100:00100000:0.0:1787836662.057506:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1787836662.057514:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2361:x1874682172258816:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836662.057595:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2361:x1874682172258816:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 81us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836662.057602:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1787836662.057619:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1787836662.057625:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2361:x1874682172258688:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836662.057650:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2361:x1874682172258688:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836662.057655:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:2.0:1787836662.059212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836662.059296:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172258560 00000100:00100000:1.0:1787836662.059305:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172258560 00000100:00100000:1.0:1787836662.059353:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172258432 00000100:00100000:1.0:1787836662.059357:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172258432 00000100:00100000:1.0:1787836662.059383:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1787836662.059403:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:2361:x1874682172258560:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836662.059464:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:2361:x1874682172258560:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 63us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836662.059472:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1787836662.059493:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1787836662.059497:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1874682172258432:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787836662.059588:0:14324:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 7302dfb5-a070-4ecc-a9fd-f6239036f535@192.168.203.25@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:1.0:1787836662.059627:0:14324:0:(genops.c:1385:class_connect()) connect: client 7302dfb5-a070-4ecc-a9fd-f6239036f535, cookie 0x966835ea68ab8891 00000004:00100000:1.0:1787836662.059674:0:14324:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1787836662.061677:0:14324:0:(import.c:65:import_set_state_nolock()) ffff98e3fadce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836662.062348:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2360:x1874682172258432:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 2844us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836662.062375:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1787836662.069232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836662.069352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836662.070277:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172258944 00000100:00100000:0.0:1787836662.070288:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172258944 00000100:00100000:0.0:1787836662.070360:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172259072 00000100:00100000:0.0:1787836662.070364:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172259072 00000100:00100000:0.0:1787836662.070399:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:0.0:1787836662.070410:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+7:0:x1874682172258944:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787836662.070463:0:15736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787836662.070531:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+7:0:x1874682172258944:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 123us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836662.070539:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:0.0:1787836662.070584:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:0.0:1787836662.070591:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:13887:x1874682172259072:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787836662.070603:0:15736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787836662.070625:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:13887:x1874682172259072:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 34us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836662.070631:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00080000:2.0:1787836662.071019:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787836662.073736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836662.073978:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172259200 00000100:00100000:0.0:1787836662.073992:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172259200 00000100:00100000:0.0:1787836662.074087:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1787836662.074099:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:13887:x1874682172259200:12345-192.168.203.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787836662.074214:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:13887:x1874682172259200:12345-192.168.203.25@tcp:40:mount.lustre.0 Request processed in 119us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836662.074222:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:2.0:1787836662.077869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836662.078049:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172259584 00000100:00100000:0.0:1787836662.078103:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172259584 00000100:00100000:0.0:1787836662.078171:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:0.0:1787836662.078181:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:13887:x1874682172259584:12345-192.168.203.25@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787836662.078475:0:14327:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787836662.078646:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:13887:x1874682172259584:12345-192.168.203.25@tcp:33:mount.lustre.0 Request processed in 465us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836662.078654:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:2.0:1787836662.081510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836662.081662:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172259328 00000100:00100000:0.0:1787836662.081672:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172259328 00000100:00100000:0.0:1787836662.081725:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:0.0:1787836662.081733:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874682172259328:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787836662.081801:0:15007:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7302dfb5-a070-4ecc-a9fd-f6239036f535@192.168.203.25@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1787836662.081971:0:15007:0:(genops.c:1385:class_connect()) connect: client 7302dfb5-a070-4ecc-a9fd-f6239036f535, cookie 0x966835ea68ab8898 00002000:00100000:0.0:1787836662.081985:0:15007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7302dfb5-a070-4ecc-a9fd-f6239036f535/ffff98e3ee0c2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787836662.081997:0:15007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787836662.082177:0:15007:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787836662.082222:0:15007:0:(import.c:65:import_set_state_nolock()) ffff98e3ee0c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787836662.082338:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2360:x1874682172259328:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 604us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836662.082347:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1787836662.083627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836662.085123:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172259456 00000100:00100000:1.0:1787836662.085142:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172259456 00000100:00100000:1.0:1787836662.085235:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:1.0:1787836662.085246:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874682172259456:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787836662.085287:0:15008:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7302dfb5-a070-4ecc-a9fd-f6239036f535@192.168.203.25@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:1.0:1787836662.085320:0:15008:0:(genops.c:1385:class_connect()) connect: client 7302dfb5-a070-4ecc-a9fd-f6239036f535, cookie 0x966835ea68ab889f 00002000:00100000:1.0:1787836662.085334:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7302dfb5-a070-4ecc-a9fd-f6239036f535/ffff98e3fadc9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113961 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787836662.085347:0:15008:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787836662.085501:0:15008:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787836662.085545:0:15008:0:(import.c:65:import_set_state_nolock()) ffff98e3fadcb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787836662.102938:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2360:x1874682172259456:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 17670us (21356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836662.102956:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:2.0:1787836662.426164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836662.438700:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172259712 00000100:00100000:1.0:1787836662.438718:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172259712 00000100:00100000:1.0:1787836662.438804:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:1.0:1787836662.438814:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c3789a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:13917:x1874682172259712:12345-192.168.203.25@tcp:101:mkdir.0 00010000:00010000:1.0:1787836662.438840:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836662.438863:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab88a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee30a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.438933:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.438965:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.438978:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836662.439214:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787836662.439218:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836662.439300:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.439327:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab88a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.440096:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836662.440106:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:1.0:1787836662.440109:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836662.440112:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5e00, rc 0) 00000100:00100000:1.0:1787836662.440193:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c3789a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+7:13917:x1874682172259712:12345-192.168.203.25@tcp:101:mkdir.0 Request processed in 1379us (14037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836662.440210:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00010000:00010000:3.0:1787836662.894364:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787836663.112896:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7302dfb5-a070-4ecc-a9fd-f6239036f535 00000001:00100000:3.0:1787836663.112913:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9b6c886-a12b-46a3-a789-dc548bbc30a4 00010000:00010000:0.0:1787836663.919036:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836664.049781:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193224704:0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.049855:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836664.049922:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787836664.049930:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c26483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193224320:0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.049961:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836664.050049:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c2648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193224832:0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.050108:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836664.050743:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193224576:0@lo:400:kworker.0 00000100:00100000:1.0:1787836664.050765:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787836664.050777:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193225216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787836664.050783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836664.050807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836664.050808:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193225088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836664.050828:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836664.050834:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c264a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193224448:0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.050875:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193224704 00000100:00100000:1.0:1787836664.050878:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836664.050883:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193224704 00000100:00100000:1.0:1787836664.050905:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193224960:0@lo:400:kworker.0 00000100:00100000:1.0:1787836664.050928:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836664.050963:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193225216 00000100:00100000:1.0:1787836664.050967:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193225216 00000100:00100000:1.0:1787836664.051003:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193225088 00000100:00100000:0.0:1787836664.051003:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193224576 00000100:00100000:1.0:1787836664.051007:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193225088 00000100:00100000:0.0:1787836664.051007:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193224576 00000100:00100000:1.0:1787836664.051028:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787836664.051030:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193224448 00000100:00100000:0.0:1787836664.051033:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193224448 00000100:00100000:1.0:1787836664.051038:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874682193225216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836664.051044:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836664.051048:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193224576:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787836664.051094:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836664.051118:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193224576:12345-0@lo:400:kworker.0 Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836664.051126:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836664.051334:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787836664.051343:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193224448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836664.051443:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193225216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 405us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836664.051451:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787836664.051452:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193224448:12345-0@lo:400:kworker.0 Request processed in 110us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836664.051457:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787836664.051467:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787836664.051473:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193225088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787836664.051492:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787836664.051522:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193225088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836664.051529:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787836664.051647:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193224832 00000100:00100000:1.0:1787836664.051647:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193224960 00000100:00100000:3.0:1787836664.051652:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193224832 00000100:00100000:1.0:1787836664.051652:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193224960 00000100:00100000:3.0:1787836664.051675:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787836664.051678:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787836664.051681:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193224704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836664.051684:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193224960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.051714:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193224704:12345-0@lo:400:kworker.0 Request processed in 35us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836664.051714:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193224960:12345-0@lo:400:kworker.0 Request processed in 29us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836664.051720:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787836664.051841:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787836664.052356:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193224320 00000100:00100000:2.0:1787836664.052363:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193224320 00000100:00100000:2.0:1787836664.052415:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787836664.052424:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3312:x1874682193224320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836664.052476:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3312:x1874682193224320:12345-0@lo:400:kworker.0 Request processed in 54us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836664.052493:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787836664.052503:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193224832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836664.052553:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193224832:12345-0@lo:400:kworker.0 Request processed in 53us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836664.052560:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787836664.052678:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787836664.052706:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193225216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836664.052740:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787836664.052740:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193224448:0@lo:400:kworker.0 00000100:00100000:1.0:1787836664.052753:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193224960:0@lo:400:kworker.0 00000100:00080000:2.0:1787836664.052775:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787836664.052782:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787836664.052784:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787836664.053967:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c26483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3312:1874682193224320:0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.054001:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c2648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193224832:0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.054015:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193224704:0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.054054:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c264b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193224576:0@lo:400:kworker.0 00000100:00100000:3.0:1787836664.054089:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193225088:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787836664.128197:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7302dfb5-a070-4ecc-a9fd-f6239036f535 00000001:00100000:1.0:1787836664.128214:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e9b6c886-a12b-46a3-a789-dc548bbc30a4 00000001:00100000:2.0:1787836664.159115:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7302dfb5-a070-4ecc-a9fd-f6239036f535 00000001:00100000:2.0:1787836664.159153:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e9b6c886-a12b-46a3-a789-dc548bbc30a4 00010000:00010000:3.0:1787836664.942258:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836665.984880:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787836666.040785:0:16289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787836666.990225:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836667.503533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836667.503651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836667.503681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836667.503701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836667.503719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836667.503737:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836667.503758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836667.503783:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172260352 00000100:00100000:1.0:1787836667.503792:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172260352 00000100:00100000:1.0:1787836667.503858:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172259968 00000100:00100000:1.0:1787836667.503861:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172259968 00000100:00100000:1.0:1787836667.503889:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1787836667.503900:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2364:x1874682172260352:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836667.503996:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2364:x1874682172260352:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836667.504024:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1787836667.504049:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:1.0:1787836667.504078:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2364:x1874682172259968:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836667.504106:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2364:x1874682172259968:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 50us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836667.504112:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:1.0:1787836667.504148:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172260096 00000100:00100000:1.0:1787836667.504152:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172260096 00000100:00100000:1.0:1787836667.504182:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172260608 00000100:00100000:1.0:1787836667.504185:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172260608 00000100:00100000:1.0:1787836667.504197:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172260224 00000100:00100000:1.0:1787836667.504200:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172260224 00000100:00100000:1.0:1787836667.504211:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172260480 00000100:00100000:1.0:1787836667.504214:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172260480 00000100:00100000:1.0:1787836667.504231:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1787836667.504237:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2364:x1874682172260096:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836667.504266:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2364:x1874682172260096:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836667.504273:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1787836667.504285:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:1.0:1787836667.504291:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2364:x1874682172260608:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836667.504315:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2364:x1874682172260608:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 24us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836667.504321:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:1.0:1787836667.504350:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1787836667.504365:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2364:x1874682172260224:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836667.504390:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2364:x1874682172260224:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836667.504396:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1787836667.504409:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:1.0:1787836667.504416:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2364:x1874682172260480:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836667.504439:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2364:x1874682172260480:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836667.504445:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00080000:1.0:1787836667.504463:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836667.504468:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787836667.504471:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836667.508841:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172259840 00000100:00100000:2.0:1787836667.508858:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172259840 00000100:00100000:2.0:1787836667.508908:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 104 00000100:00100000:2.0:1787836667.508918:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:2364:x1874682172259840:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836667.509003:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:2364:x1874682172259840:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 87us (5484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836667.509012:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 104 00010000:00010000:0.0:1787836668.014281:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836669.038853:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836669.169029:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787836669.169370:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193225472:0@lo:400:kworker.0 00000100:00100000:3.0:1787836669.169437:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5caf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193225856:0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.169457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836669.169516:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193225984:0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.169546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836669.169574:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787836669.169581:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193225600:0@lo:400:kworker.0 00000100:00100000:1.0:1787836669.169598:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193225344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836669.169609:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836669.169636:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193226112:0@lo:400:kworker.0 00000100:00100000:1.0:1787836669.169643:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836669.169672:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836669.169677:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193225728:0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.169747:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193225984 00000100:00100000:0.0:1787836669.169755:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193225984 00000100:00100000:3.0:1787836669.169782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836669.169821:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193226112 00000100:00100000:0.0:1787836669.169825:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193226112 00000100:00100000:3.0:1787836669.169838:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193225856 00000100:00100000:3.0:1787836669.169844:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193225856 00000100:00100000:0.0:1787836669.169851:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787836669.169862:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193225984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836669.169873:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787836669.169883:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193226112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.169922:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874682193225984:12345-0@lo:400:kworker.0 Request processed in 61us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836669.169929:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787836669.169944:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787836669.169950:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193225856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.169980:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874682193225856:12345-0@lo:400:kworker.0 Request processed in 30us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836669.169986:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787836669.170017:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193225600 00000100:00100000:0.0:1787836669.170021:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193225600 00000100:00100000:0.0:1787836669.170050:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787836669.170085:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193225600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.170127:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193225600:12345-0@lo:400:kworker.0 Request processed in 70us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836669.170133:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787836669.170165:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787836669.170170:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836669.170253:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193225472 00000100:00100000:2.0:1787836669.170258:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193225472 00000100:00100000:2.0:1787836669.170291:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787836669.170299:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3310:x1874682193225472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836669.170340:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3310:x1874682193225472:12345-0@lo:400:kworker.0 Request processed in 44us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836669.170347:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787836669.170479:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193225600:0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.170490:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193225472:0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.170500:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874682193225984:0@lo:400:kworker.0 00000100:00100000:3.0:1787836669.170584:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193226112:12345-0@lo:400:kworker.0 Request processed in 701us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836669.170592:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787836669.170622:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5caf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874682193225856:0@lo:400:kworker.0 00000100:00100000:3.0:1787836669.170634:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787836669.170641:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193226240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787836669.170668:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836669.170700:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193225344 00000100:00100000:3.0:1787836669.170704:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193225344 00000100:00100000:3.0:1787836669.170722:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193226240 00000100:00100000:3.0:1787836669.170724:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193226240 00000100:00100000:3.0:1787836669.170744:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787836669.170750:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193225344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787836669.170777:0:15011:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836669.170811:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193225344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836669.170817:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787836669.170829:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787836669.170835:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193226240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787836669.170855:0:15011:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787836669.170886:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874682193226240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836669.170892:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787836669.170994:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193226112:0@lo:400:kworker.0 00000100:00100000:1.0:1787836669.171043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836669.171179:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193225344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787836669.172521:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874682193226240:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787836669.172564:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787836669.172581:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193225728 00000100:00100000:0.0:1787836669.172589:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193225728 00000100:00100000:0.0:1787836669.172646:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787836669.172656:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193225728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836669.172735:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193225728:12345-0@lo:400:kworker.0 Request processed in 82us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836669.172742:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787836669.174902:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193225728:0@lo:400:kworker.0 00010000:00010000:1.0:1787836670.062280:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787836670.472383:0:16436:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde16811f0 20000000:00000080:0.0:1787836670.472412:0:16436:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98e2c1e43000 uarg=0000000000000000 20000000:01000000:0.0:1787836670.472446:0:16436:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787836670.472452:0:16436:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787836670.472456:0:16436:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787836670.473624:0:16437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787836670.473831:0:16436:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787836670.486848:0:16436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787836670.489495:0:16436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.489516:0:16436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.489524:0:16436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.489531:0:16436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab8725 expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.489540:0:16436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.489547:0:16436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.489556:0:16436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.489838:0:16436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.489866:0:16436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 12 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836670.489881:0:16436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226368:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836670.490012:0:16436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.490021:0:16436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 12 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836670.490030:0:16436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c604cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226496:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836670.494769:0:16436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab8725 expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.494791:0:16436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab8725 expref: 18 pid: 14317 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836670.494810:0:16436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226624:0@lo:104: 00000100:00100000:3.0:1787836670.499180:0:16436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836670.499258:0:16436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.499275:0:16436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 18 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836670.499290:0:16436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226752:0@lo:104: 00000100:00100000:3.0:1787836670.499333:0:16436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787836670.499354:0:16436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 18 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.499362:0:16436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 18 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836670.499371:0:16436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226880:0@lo:104: 00000100:00100000:1.0:1787836670.500025:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193226624 00000100:00100000:1.0:1787836670.500035:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193226624 00000100:00100000:1.0:1787836670.500102:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193226752 00000100:00100000:1.0:1787836670.500117:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193226752 00000100:00100000:1.0:1787836670.500136:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836670.500153:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+4:16436:x1874682193226624:12345-0@lo:104: 00010000:00010000:1.0:1787836670.500167:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500230:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787836670.500235:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+4:16436:x1874682193226624:12345-0@lo:104: Request processed in 84us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836670.500242:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836670.500260:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836670.500266:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:16436:x1874682193226752:12345-0@lo:104: 00010000:00010000:1.0:1787836670.500273:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500301:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787836670.500305:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:16436:x1874682193226752:12345-0@lo:104: Request processed in 40us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836670.500310:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787836670.500329:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787836670.500334:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500340:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3d005bc00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836670.500344:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500352:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836670.500368:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836670.500374:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787836670.500418:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500424:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836670.500441:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500448:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e3d005bc00/0x966835ea68ab8725 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab872c expref: -99 pid: 15724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500460:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787836670.500463:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500467:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e2c13ace00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:1.0:1787836670.500470:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500476:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787836670.500481:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787836670.500486:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787836670.500502:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500508:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787836670.500524:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500530:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e2c13ace00/0x966835ea68ab85f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab85f8 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500539:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836670.500541:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836670.500542:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787836670.500548:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836670.500566:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3313:1874682193227008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836670.500599:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836670.500654:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787836670.500663:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3311:1874682193227136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836670.500691:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836670.500715:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193227008 00000100:00100000:1.0:1787836670.500719:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193227008 00010000:00010000:1.0:1787836670.500741:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8725 expref: 19 pid: 14317 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836670.500765:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193227136 00000100:00100000:1.0:1787836670.500768:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193227136 00010000:00010000:1.0:1787836670.500777:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 20 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836670.500787:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836670.500792:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+20:3313:x1874682193227008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787836670.500809:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836670.500814:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab8725 expref: 20 pid: 14317 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500823:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab8725 expref: 20 pid: 14317 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500839:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836670.500867:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+20:3313:x1874682193227008:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836670.500873:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787836670.500886:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836670.500891:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3311:x1874682193227136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787836670.500903:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836670.500908:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 19 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500916:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 19 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836670.500925:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836670.500949:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3311:x1874682193227136:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836670.500954:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787836670.500987:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3311:1874682193227136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787836670.501017:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3313:1874682193227008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787836670.501767:0:16436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836670.501810:0:16436:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3ce12e0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787836670.501829:0:16436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e401d3fe00/0x966835ea68ab872c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab8725 expref: 18 pid: 14317 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836670.501841:0:16436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226624:0@lo:104: 00010000:00010000:3.0:1787836670.501952:0:16436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e2c13ac200/0x966835ea68ab85f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab85f1 expref: 17 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836670.501963:0:16436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226752:0@lo:104: 00000100:00100000:3.0:1787836670.502176:0:16436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226368:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836670.502186:0:16436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c604cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226496:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836670.502257:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787836670.502271:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193226880 00000100:00100000:0.0:1787836670.502276:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193226880 00000100:00100000:0.0:1787836670.502311:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836670.502328:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:16436:x1874682193226880:12345-0@lo:104: 00010000:00010000:0.0:1787836670.502341:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.502525:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787836670.502531:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c7ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+3:16436:x1874682193226880:12345-0@lo:104: Request processed in 205us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836670.502539:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787836670.502658:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787836670.502664:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.502672:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e401d3fa00 already unused, calling callback (ffffffffc1bc4c20) 10000000:00010000:0.0:1787836670.502676:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.502685:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787836670.502692:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836670.502697:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787836670.502729:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.502735:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787836670.502754:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.502771:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff98e401d3fa00/0x966835ea68ab85a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x966835ea68ab85ab expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.502785:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836670.502787:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787836670.502789:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836670.502796:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836670.502809:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193227264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787836670.502843:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836670.503202:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193227264 00000100:00100000:0.0:1787836670.503206:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193227264 00010000:00010000:0.0:1787836670.503228:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 17 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836670.503258:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787836670.503266:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c5128050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:3310:x1874682193227264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787836670.503277:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836670.503282:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 17 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.503291:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 17 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.503306:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836670.503335:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c5128050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:3310:x1874682193227264:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836670.503342:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787836670.503595:0:16436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f4a00/0x966835ea68ab85ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x966835ea68ab85a4 expref: 16 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836670.503607:0:16436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16436:1874682193226880:0@lo:104: 00010000:00010000:3.0:1787836670.503640:0:16436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836670.503938:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193227264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787836670.521918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836670.522132:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172260864 00000100:00100000:2.0:1787836670.522153:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172260864 00010000:00010000:2.0:1787836670.522203:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 13 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836670.522251:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:2.0:1787836670.522261:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:2364:x1874682172260864:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836670.522279:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836670.522284:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 13 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836670.522295:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 13 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836670.522331:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c152b600/0x966835ea68ab8852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee27e expref: 13 pid: 14318 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836670.522346:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836670.522414:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:2364:x1874682172260864:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 154us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836670.522422:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1787836670.526908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836670.527028:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172260736 00000100:00100000:0.0:1787836670.527038:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172260736 00010000:00010000:0.0:1787836670.527113:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 12 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836670.527165:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:0.0:1787836670.527174:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:2363:x1874682172260736:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836670.527189:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836670.527194:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 12 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527207:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 12 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527226:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3ce1f5400/0x966835ea68ab888a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2e0 expref: 12 pid: 14319 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527242:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527252:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527266:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527273:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527279:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527293:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527300:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152be00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836670.527304:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527312:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527334:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836670.527345:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836670.527925:0:16436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.527935:0:16436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836670.527942:0:16436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88b4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836670.528803:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:2363:x1874682172260736:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 1622us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836670.528815:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00010000:00010000:1.0:1787836671.087379:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787836671.477862:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787836671.855117:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787836671.855125:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e2c2db7800 from 10 10000000:01000000:0.0:1787836671.855140:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787836671.855180:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab88bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.855191:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab88bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.855202:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab88bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836671.855228:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787836671.855300:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836671.855354:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836671.855436:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193227392 00000100:00100000:1.0:1787836671.855444:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193227392 00000100:00100000:1.0:1787836671.855527:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787836671.855537:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3e8bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+16:14321:x1874682193227392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787836671.855549:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836671.855562:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab88c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab88bb expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836671.855586:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab88c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab88bb expref: 17 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836671.855595:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f5200/0x966835ea68ab88c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab88bb expref: 17 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836671.855604:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5200, rc 0) 00000100:00100000:1.0:1787836671.855653:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3e8bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:14321:x1874682193227392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836671.855659:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787836671.855736:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836671.855750:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab88bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88c2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.855759:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab88bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab88c2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836671.855811:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836671.855836:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836671.858608:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836671.858822:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193227520 00000100:00100000:3.0:1787836671.858832:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193227520 00000100:00100000:3.0:1787836671.858876:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787836671.858885:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:14321:x1874682193227520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836671.859206:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:14321:x1874682193227520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836671.859214:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787836671.859517:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787836671.859571:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836671.859619:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836671.859653:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836671.859764:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193227648 00000100:00100000:3.0:1787836671.859769:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193227648 00000100:00100000:3.0:1787836671.859794:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787836671.859800:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:14321:x1874682193227648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836671.860002:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:14321:x1874682193227648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836671.860009:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787836671.862689:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787836671.864339:0:16485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787836671.864539:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787836671.864562:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787836671.864573:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab88bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88c2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.864584:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c0030400/0x966835ea68ab88bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88c2 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787836671.864592:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787836671.864608:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3c833e000 from 10 10000000:01000000:0.0:1787836671.864611:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787836671.864646:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab88c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.864654:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab88c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.864665:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab88c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836671.864688:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787836671.864765:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836671.864847:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787836671.867252:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193227776 00000100:00100000:3.0:1787836671.867265:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193227776 00000100:00100000:2.0:1787836671.867390:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787836671.867403:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+17:14321:x1874682193227776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836671.867421:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787836671.867441:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3d005bc00/0x966835ea68ab88d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab88c9 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836671.867470:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3d005bc00/0x966835ea68ab88d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab88c9 expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836671.867481:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3d005bc00/0x966835ea68ab88d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab88c9 expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836671.867491:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3d005bc00, rc 0) 00000100:00100000:2.0:1787836671.867583:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:14321:x1874682193227776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836671.867590:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787836671.867672:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836671.867689:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab88c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88d0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836671.867707:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab88c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab88d0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836671.867776:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836671.867808:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836671.867852:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651900 going to sleep for 11 seconds 00000100:00100000:2.0:1787836671.867948:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193227904 00000100:00100000:2.0:1787836671.867953:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193227904 00000100:00100000:2.0:1787836671.867996:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787836671.868003:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:14321:x1874682193227904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836671.868298:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:14321:x1874682193227904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836671.868306:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787836671.868531:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193227904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836671.868569:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193228032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836671.868607:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836671.868636:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651900 going to sleep for 11 seconds 00000100:00100000:3.0:1787836671.868651:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193228032 00000100:00100000:3.0:1787836671.868655:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193228032 00000100:00100000:3.0:1787836671.868677:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787836671.868684:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:14321:x1874682193228032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787836671.875882:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:14321:x1874682193228032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7187us (7263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836671.875897:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787836671.875995:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193228032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787836671.878545:0:16488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787836671.879035:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787836671.879085:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787836671.879098:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab88c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88d0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836671.879110:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3c0031c00/0x966835ea68ab88c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88d0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787836671.879121:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787836671.879124:0:14321:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98e3fabd3000 from 10 10000000:01000000:2.0:1787836671.879127:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787836671.879177:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005a000/0x966835ea68ab88d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836671.879185:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff98e3d005a000/0x966835ea68ab88d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836671.879196:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff98e3d005a000/0x966835ea68ab88d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836671.879239:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193228160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787836671.879308:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836671.879355:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3f6e71cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836671.879790:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193228160 00000100:00100000:0.0:1787836671.879797:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193228160 00000100:00100000:0.0:1787836671.879846:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787836671.879855:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+18:14321:x1874682193228160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787836671.879868:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836671.879880:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c0031400/0x966835ea68ab88de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x966835ea68ab88d7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.879902:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c0031400/0x966835ea68ab88de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x966835ea68ab88d7 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.879913:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c0031400/0x966835ea68ab88de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x966835ea68ab88d7 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836671.879921:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031400, rc 0) 00000100:00100000:0.0:1787836671.879968:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:14321:x1874682193228160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836671.880314:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193228160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787836671.880332:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff98e3d005a000/0x966835ea68ab88d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88de expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836671.880342:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff98e3d005a000/0x966835ea68ab88d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x966835ea68ab88de expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836671.880400:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193228288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836671.880434:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836671.880452:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3f6e71cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836671.880468:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193228288 00000100:00100000:2.0:1787836671.880472:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193228288 00000100:00100000:0.0:1787836671.880684:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787836671.880775:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787836671.880784:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+20:14321:x1874682193228288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787836671.882359:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:14321:x1874682193228288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1567us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836671.882373:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787836671.887365:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193228288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836671.887430:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e401fd7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193228416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836671.887504:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836671.887594:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3e9651cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836671.891935:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193228416 00000100:00100000:0.0:1787836671.891949:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193228416 00000100:00100000:0.0:1787836671.892078:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787836671.892089:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:14321:x1874682193228416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787836671.892358:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:14321:x1874682193228416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (4853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836671.892368:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787836671.892479:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e401fd7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:54169f9e-8f3c-47d1-ba67-76dd190fcd61:14321:1874682193228416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787836671.905455:0:16489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787836671.905989:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787836671.906021:0:14321:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787836671.906034:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff98e3d005a000/0x966835ea68ab88d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88de expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836671.906047:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff98e3d005a000/0x966835ea68ab88d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x966835ea68ab88de expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836672.106786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836672.107260:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172260992 00000100:00100000:1.0:1787836672.107280:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172260992 00000100:00100000:1.0:1787836672.107836:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:1.0:1787836672.107849:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+11:13770:x1874682172260992:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787836672.107868:0:14319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836672.107885:0:14319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3ce1f5000/0x966835ea68ab88e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee311 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836672.107913:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3ce1f5000/0x966835ea68ab88e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee311 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836672.107924:0:14319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3ce1f5000/0x966835ea68ab88e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee311 expref: 12 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836672.107933:0:14319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5000, rc 0) 00000100:00100000:1.0:1787836672.108009:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13770:x1874682172260992:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 162us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836672.108016:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 115 00010000:00010000:3.0:1787836672.115877:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787836672.118826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836672.118869:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172261120 00000100:00100000:1.0:1787836672.118880:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172261120 00000100:00100000:1.0:1787836672.118936:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:1.0:1787836672.118946:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13770:x1874682172261120:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787836672.120244:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13770:x1874682172261120:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 1293us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836672.120255:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:1.0:1787836672.122997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836672.123088:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172261248 00000100:00100000:3.0:1787836672.123096:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172261248 00000100:00100000:3.0:1787836672.123143:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:3.0:1787836672.123152:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13770:x1874682172261248:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836672.123339:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13770:x1874682172261248:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 186us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836672.123347:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:1.0:1787836672.127944:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836672.128252:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172261376 00000100:00100000:3.0:1787836672.128260:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172261376 00000100:00100000:3.0:1787836672.128312:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:3.0:1787836672.128322:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+12:13770:x1874682172261376:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787836672.128348:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836672.128367:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee318 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836672.128395:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee318 expref: 13 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836672.128406:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98e3c152be00/0x966835ea68ab88ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee318 expref: 13 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836672.128415:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152be00, rc 0) 00000100:00100000:3.0:1787836672.128461:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13770:x1874682172261376:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 141us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836672.128468:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:1.0:1787836672.131944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836672.132075:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172261504 00000100:00100000:3.0:1787836672.132085:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172261504 00000100:00100000:3.0:1787836672.132207:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:3.0:1787836672.132216:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13770:x1874682172261504:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787836672.132476:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13770:x1874682172261504:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 260us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836672.132483:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:1.0:1787836672.147109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836672.148193:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172261632 00000100:00100000:3.0:1787836672.148206:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172261632 00000100:00100000:3.0:1787836672.148256:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:3.0:1787836672.148266:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13770:x1874682172261632:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787836672.148470:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:13770:x1874682172261632:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 204us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836672.148483:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:3.0:1787836672.618396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836672.618441:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836672.618476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836672.618611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836672.618664:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172261760 00000100:00100000:0.0:1787836672.618675:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172261760 00000100:00100000:0.0:1787836672.618744:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1787836672.618754:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2363:x1874682172261760:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836672.618830:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2363:x1874682172261760:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 77us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836672.618838:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:3.0:1787836672.620155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836672.620187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836672.620348:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172262016 00000100:00100000:1.0:1787836672.620356:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172262016 00000100:00080000:3.0:1787836672.620435:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836672.620448:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172262144 00000100:00100000:3.0:1787836672.620452:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172262144 00000100:00100000:3.0:1787836672.620525:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:3.0:1787836672.620535:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2363:x1874682172262144:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836672.620600:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2363:x1874682172262144:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 67us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836672.620607:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00080000:1.0:1787836672.621378:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787836672.621494:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172262272 00000100:00100000:2.0:1787836672.621502:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172262272 00000100:00100000:2.0:1787836672.621552:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172261888 00000100:00100000:2.0:1787836672.621555:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172261888 00000100:00100000:2.0:1787836672.621571:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172262400 00000100:00100000:2.0:1787836672.621589:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172262400 00000100:00100000:2.0:1787836672.621612:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1787836672.621619:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2363:x1874682172262272:12345-192.168.203.25@tcp:400:kworker.0 00000100:00080000:1.0:1787836672.621825:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787836672.621829:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836672.621868:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2363:x1874682172262272:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 248us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836672.621876:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1787836672.621895:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:2.0:1787836672.621902:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2363:x1874682172261888:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836672.621928:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2363:x1874682172261888:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836672.621934:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:2.0:1787836672.621945:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:2.0:1787836672.621951:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2363:x1874682172262400:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836672.621972:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2363:x1874682172262400:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 21us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836672.621977:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1787836672.623444:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1787836672.623455:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2363:x1874682172262016:12345-192.168.203.25@tcp:400:kworker.0 00000100:00080000:3.0:1787836672.623575:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787836672.623635:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2363:x1874682172262016:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 181us (5192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836672.623642:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00010000:00010000:1.0:1787836673.134310:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787836674.158628:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787836674.286832:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5a8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193228544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836674.286909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836674.287098:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193228544 00000100:00100000:0.0:1787836674.287106:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193228544 00000100:00100000:0.0:1787836674.287173:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787836674.287181:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c37892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193228544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787836674.287215:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836674.287261:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c37892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193228544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.287269:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787836674.287410:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836674.287579:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193229056:0@lo:400:kworker.0 00000100:00100000:2.0:1787836674.287608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836674.287643:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5a8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193228544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836674.287673:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787836674.287679:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193228672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836674.287718:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836674.287739:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193229184:0@lo:400:kworker.0 00000100:00100000:2.0:1787836674.287758:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836674.288097:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193228800:0@lo:400:kworker.0 00000100:00100000:0.0:1787836674.288153:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836674.288171:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193229312:0@lo:400:kworker.0 00000100:00100000:0.0:1787836674.288191:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836674.288207:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787836674.288212:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e2c378b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193228928:0@lo:400:kworker.0 00000100:00100000:0.0:1787836674.288233:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787836674.288260:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193229056 00000100:00100000:0.0:1787836674.288264:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193229056 00000100:00100000:0.0:1787836674.288292:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193229184 00000100:00100000:0.0:1787836674.288295:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193229184 00000100:00100000:0.0:1787836674.288308:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193229312 00000100:00100000:0.0:1787836674.288310:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193229312 00000100:00100000:0.0:1787836674.288322:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787836674.288328:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193229056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836674.288367:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193229056:12345-0@lo:400:kworker.0 Request processed in 40us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.288374:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787836674.288386:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787836674.288391:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193229184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836674.288418:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874682193229184:12345-0@lo:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.288423:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787836674.288434:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787836674.288439:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193229312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836674.288480:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193229312:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.288496:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787836674.288529:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5ee9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193229312:0@lo:400:kworker.0 00000100:00100000:0.0:1787836674.288547:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193228672 00000100:00100000:0.0:1787836674.288550:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193228672 00000100:00100000:0.0:1787836674.288576:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787836674.288582:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193228672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787836674.288607:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787836674.288636:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874682193228672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.288642:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787836674.288683:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c3788780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193228672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836674.288693:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874682193229184:0@lo:400:kworker.0 00000100:00100000:0.0:1787836674.288709:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193229056:0@lo:400:kworker.0 00000100:00100000:3.0:1787836674.288903:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193228800 00000100:00100000:3.0:1787836674.288908:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193228800 00000100:00100000:3.0:1787836674.288944:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787836674.288951:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c18f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3310:x1874682193228800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836674.288986:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c18f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3310:x1874682193228800:12345-0@lo:400:kworker.0 Request processed in 37us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836674.288992:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1787836674.289019:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787836674.289029:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836674.289046:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3310:1874682193228800:0@lo:400:kworker.0 00000100:00100000:1.0:1787836674.289452:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193228928 00000100:00100000:1.0:1787836674.289456:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193228928 00000100:00100000:1.0:1787836674.289494:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787836674.289503:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193228928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836674.289541:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193228928:12345-0@lo:400:kworker.0 Request processed in 41us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836674.289547:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787836674.289701:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e2c378b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193228928:0@lo:400:kworker.0 00000100:00100000:3.0:1787836674.510506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.510665:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172262528 00000100:00100000:0.0:1787836674.510677:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172262528 00000100:00100000:0.0:1787836674.510778:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1787836674.510790:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:14426:x1874682172262528:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787836674.510814:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.510837:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab88f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee31f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.510914:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.510931:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.510975:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.510991:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.510999:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511006:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511625:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031800/0x966835ea68ab8908 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511636:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031800/0x966835ea68ab8908 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511644:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031800/0x966835ea68ab8908 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.511730:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787836674.511734:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836674.511831:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031800/0x966835ea68ab8908 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511843:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511849:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511865:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511872:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.511876:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511884:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511899:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:0.0:1787836674.511903:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.511909:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511915:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab88fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511930:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511936:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511942:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511948:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.511950:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511967:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511977:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98e3e9516000) 00010000:00010000:0.0:1787836674.511979:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.511983:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.511989:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8901 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.512029:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab88f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee31f expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.512044:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031800/0x966835ea68ab8908 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee31f expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.512051:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e3e9516c00) 00010000:00010000:0.0:1787836674.512053:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836674.512055:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031800, rc 0) 00000100:00100000:0.0:1787836674.512198:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:14426:x1874682172262528:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1409us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.512207:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00080000:3.0:1787836674.512315:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836674.521838:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.522156:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172262784 00000100:00100000:0.0:1787836674.522166:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172262784 00000100:00100000:0.0:1787836674.522278:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:0.0:1787836674.522289:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:14426:x1874682172262784:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787836674.522329:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.522351:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab890f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee326 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.522417:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.522429:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.522439:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.522497:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.522505:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.522513:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523099:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab8924 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523110:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab8924 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523128:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab8924 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.523139:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787836674.523399:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523408:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523415:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523421:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.523425:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523433:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523446:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98e3e9516c00) 00010000:00010000:0.0:1787836674.523449:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.523454:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523460:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8916 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523473:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523479:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523484:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523499:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.523502:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523509:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523517:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98e3e9516000) 00010000:00010000:0.0:1787836674.523520:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.523523:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523529:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab891d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523910:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab890f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee326 expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523926:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031a00/0x966835ea68ab8924 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee326 expref: 9 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.523934:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3e9516600) 00010000:00010000:0.0:1787836674.523936:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.523938:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031a00, rc 0) 00000100:00100000:0.0:1787836674.524028:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14426:x1874682172262784:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1739us (2200us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787836674.524038:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1787836674.534221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.536254:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172262912 00000100:00100000:0.0:1787836674.536285:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172262912 00000100:00100000:0.0:1787836674.536348:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:0.0:1787836674.536358:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14426:x1874682172262912:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787836674.536465:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14426:x1874682172262912:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 109us (2254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.536473:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000040:00080000:0.0:1787836674.544707:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787836674.590584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836674.590683:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172263040 00000100:00100000:3.0:1787836674.590695:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172263040 00000100:00100000:3.0:1787836674.590766:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1787836674.590777:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14432:x1874682172263040:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1787836674.590797:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836674.590822:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee32d expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.590886:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.590902:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.590915:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.590930:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.590938:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.590944:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591536:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591544:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591549:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591555:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152ac00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836674.591559:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591565:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591577:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:3.0:1787836674.591580:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836674.591584:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591591:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591602:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591607:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591612:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591624:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836674.591627:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591633:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591642:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e3c5445e00) 00010000:00010000:3.0:1787836674.591645:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836674.591807:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591817:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8940 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591853:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8932 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee32d expref: 10 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591864:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:3.0:1787836674.591867:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836674.591870:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee32d expref: 10 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.591880:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b200, rc 0) 00000100:00100000:3.0:1787836674.592021:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14432:x1874682172263040:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1173us (1374us total) trans 0 rc 301/301 00000100:00100000:3.0:1787836674.592031:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1787836674.602859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.602985:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172263168 00000100:00100000:0.0:1787836674.602994:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172263168 00000100:00100000:0.0:1787836674.603043:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:0.0:1787836674.603052:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14432:x1874682172263168:12345-192.168.203.25@tcp:700:lfs.0 00000100:00100000:0.0:1787836674.603348:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14432:x1874682172263168:12345-192.168.203.25@tcp:700:lfs.0 Request processed in 295us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.603355:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1787836674.605817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.612636:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172263424 00000100:00100000:0.0:1787836674.612654:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172263424 00000100:00100000:0.0:1787836674.612733:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:0.0:1787836674.612744:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14432:x1874682172263424:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:0.0:1787836674.613224:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836674.613251:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8875 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee2a8 expref: 9 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.613272:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:0.0:1787836674.613277:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836674.613553:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.613578:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 5 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.613587:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.613620:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 5 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.613635:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 5 pid: 14325 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836674.613648:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5caed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1874682193229440:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836674.613757:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787836674.616498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836674.616619:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172263552 00000100:00100000:3.0:1787836674.616628:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172263552 00010000:00010000:3.0:1787836674.616693:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 6 pid: 14325 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836674.616735:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:3.0:1787836674.616744:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2364:x1874682172263552:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836674.616759:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836674.616767:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 6 pid: 14325 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.616781:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 6 pid: 14325 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.616807:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:3.0:1787836674.616812:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.616821:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.616829:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.616849:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836674.616903:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2364:x1874682172263552:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 160us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836674.616910:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00080000:1.0:1787836674.617738:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787836674.618376:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab88ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee30a expref: 5 pid: 14325 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836674.618396:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5caed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1874682193229440:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836674.618419:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.618430:0:14325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.618436:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.618464:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.618557:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.618568:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836674.623936:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787836674.623957:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.623980:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.623988:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.623994:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836674.623999:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.624007:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.624024:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:1.0:1787836674.624027:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836674.624033:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.624039:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8947 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836674.625291:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cceaf234 reply state 000000009d18709a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836674.625307:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836674.625425:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+10:14432:x1874682172263424:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 12679us (19611us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787836674.625434:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00010000:00010000:3.0:1787836674.629869:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.629903:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.629911:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.629917:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836674.629921:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.629930:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.629947:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e3e9516000) 00010000:00010000:3.0:1787836674.629951:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836674.629956:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.629962:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab894e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836674.746553:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.747796:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172263680 00000100:00100000:0.0:1787836674.747808:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172263680 00000100:00100000:0.0:1787836674.747882:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:0.0:1787836674.747893:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:14440:x1874682172263680:12345-192.168.203.25@tcp:101:lctl.0 00010000:00010000:0.0:1787836674.747916:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.747939:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee334 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.748017:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab895c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.748031:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab895c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.748042:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab895c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.748257:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787836674.748262:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836674.748305:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab895c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.748330:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee334 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.748367:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030800/0x966835ea68ab895c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee334 expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.748375:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:0.0:1787836674.748378:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836674.748382:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030800, rc 0) 00000100:00100000:0.0:1787836674.748440:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+10:14440:x1874682172263680:12345-192.168.203.25@tcp:101:lctl.0 Request processed in 549us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.748446:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1787836674.796187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.797711:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172263808 00000100:00100000:0.0:1787836674.797724:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172263808 00000100:00100000:0.0:1787836674.797855:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1787836674.797867:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:14441:x1874682172263808:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836674.797889:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.797911:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee33b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.797988:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab896a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.798004:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab896a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.798018:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab896a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.801416:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787836674.801444:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836674.801498:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab896a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.801538:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab8963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee33b expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.801559:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030c00/0x966835ea68ab896a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee33b expref: 6 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.801568:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:0.0:1787836674.801571:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836674.801574:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030c00, rc 0) 00000100:00100000:0.0:1787836674.801646:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:14441:x1874682172263808:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 3781us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.801666:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:1.0:1787836674.808964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.809095:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172263936 00000100:00100000:0.0:1787836674.809108:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172263936 00000100:00100000:0.0:1787836674.809177:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:0.0:1787836674.809187:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:14441:x1874682172263936:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836674.809207:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.809227:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab8971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee342 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809292:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809308:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809332:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809348:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809355:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809361:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809525:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030a00/0x966835ea68ab8986 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809534:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030a00/0x966835ea68ab8986 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809541:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030a00/0x966835ea68ab8986 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.809580:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787836674.809584:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836674.809605:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030a00/0x966835ea68ab8986 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809616:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809622:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809639:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809645:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.809909:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809919:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809931:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:0.0:1787836674.809934:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.809940:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809946:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab8978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809960:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809965:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809969:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809974:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.809977:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.809993:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.810000:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e3e9516700) 00010000:00010000:0.0:1787836674.810002:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.810005:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.810012:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab897f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.810045:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab8971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee342 expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.810256:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030a00/0x966835ea68ab8986 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee342 expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.810265:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516800) 00010000:00010000:0.0:1787836674.810268:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836674.810270:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030a00, rc 0) 00000100:00100000:0.0:1787836674.810332:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+7:14441:x1874682172263936:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1147us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.810339:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:3.0:1787836674.823042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836674.823303:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172264192 00000100:00100000:1.0:1787836674.823313:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172264192 00000100:00100000:1.0:1787836674.823374:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1787836674.823384:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+7:14441:x1874682172264192:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836674.823406:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836674.823425:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab898d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee349 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836674.823554:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787836674.823680:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab898d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee349 expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.823693:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:1.0:1787836674.823697:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836674.823702:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab898d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee349 expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.823715:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5800, rc 0) 00000100:00100000:1.0:1787836674.823773:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+8:14441:x1874682172264192:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 391us (743us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787836674.823780:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:1.0:1787836674.830692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836674.830933:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172264448 00000100:00100000:3.0:1787836674.830944:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172264448 00000100:00100000:3.0:1787836674.831006:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:3.0:1787836674.831016:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+8:14441:x1874682172264448:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:3.0:1787836674.831106:0:15736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836674.831143:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030a00/0x966835ea68ab8986 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee342 expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.831175:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516800) 00010000:00010000:3.0:1787836674.831186:0:15736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836674.831211:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.831223:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836674.831231:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787836674.831440:0:15736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c55f339 reply state 00000000857f2452 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836674.831450:0:15736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787836674.831463:0:15736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787836674.831578:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+9:14441:x1874682172264448:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 562us (895us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787836674.831585:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:3.0:1787836674.840011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.840124:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172264704 00000100:00100000:0.0:1787836674.840135:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172264704 00000100:00100000:0.0:1787836674.840200:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:0.0:1787836674.840210:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+9:14441:x1874682172264704:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1787836674.840492:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+10:14441:x1874682172264704:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 283us (491us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787836674.840499:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00010000:00010000:2.0:1787836674.842876:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836674.842894:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836674.842902:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836674.842908:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836674.842912:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836674.842920:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836674.842941:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3c5445e00) 00010000:00010000:2.0:1787836674.842944:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787836674.842949:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836674.842955:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab899b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836674.844119:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.844377:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172264960 00000100:00100000:0.0:1787836674.844387:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172264960 00000100:00100000:0.0:1787836674.844441:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:0.0:1787836674.844449:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+9:14441:x1874682172264960:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836674.844481:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.844499:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab89a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee350 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844566:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844579:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844590:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844604:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844611:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844617:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.844752:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787836674.844863:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844871:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844877:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844883:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.844887:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844895:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844907:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:0.0:1787836674.844910:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.844914:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844920:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844933:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844939:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844944:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844959:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.844962:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844969:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844977:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e3e9516700) 00010000:00010000:0.0:1787836674.844979:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.844982:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.844988:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.845295:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab89a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee350 expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.845306:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:0.0:1787836674.845308:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787836674.845312:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab89a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee350 expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.845322:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0030e00, rc 0) 00000100:00100000:0.0:1787836674.845383:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+10:14441:x1874682172264960:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 934us (1324us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787836674.845390:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:3.0:1787836674.853213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.853394:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172265088 00000100:00100000:0.0:1787836674.853419:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172265088 00000100:00100000:0.0:1787836674.853487:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:0.0:1787836674.853498:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+10:14441:x1874682172265088:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836674.853525:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.853549:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab89be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee357 expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.853671:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.853685:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.853696:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.853750:0:15736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787836674.853755:0:15736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836674.853783:0:15736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.853816:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab89be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 12 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.853834:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 11 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.853842:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516700) 00010000:00010000:0.0:1787836674.853845:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787836674.853848:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031200, rc 0) 00000100:00100000:0.0:1787836674.853925:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7302dfb5-a070-4ecc-a9fd-f6239036f535+11:14441:x1874682172265088:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 429us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.853933:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:3.0:1787836674.858513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.858585:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172265216 00000100:00100000:0.0:1787836674.858594:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172265216 00000100:00100000:0.0:1787836674.858660:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1787836674.858670:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+11:14441:x1874682172265216:12345-192.168.203.25@tcp:37:lfs.0 00000100:00100000:0.0:1787836674.864142:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7302dfb5-a070-4ecc-a9fd-f6239036f535+11:14441:x1874682172265216:12345-192.168.203.25@tcp:37:lfs.0 Request processed in 5462us (5627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.864156:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:3.0:1787836674.868264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836674.868421:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172265472 00000100:00100000:1.0:1787836674.868432:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172265472 00000100:00100000:1.0:1787836674.868504:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1787836674.868515:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee8d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+11:14441:x1874682172265472:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1787836674.868808:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee8d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+12:14441:x1874682172265472:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 294us (551us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787836674.868816:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:3.0:1787836674.935000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.935194:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172265600 00000100:00100000:0.0:1787836674.935205:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172265600 00000100:00100000:0.0:1787836674.935277:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:0.0:1787836674.935288:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+10:14447:x1874682172265600:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1787836674.935310:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.935337:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab89cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee35e expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935408:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935425:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935439:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935456:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935482:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935490:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935614:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab89e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935623:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab89e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935631:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab89e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.935680:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787836674.935685:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836674.935733:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab89e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935747:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935753:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935760:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935766:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0030600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.935769:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935784:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935796:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:0.0:1787836674.935800:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.935804:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935811:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030600/0x966835ea68ab89d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935828:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935833:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935838:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935842:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c0031e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.935845:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935850:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935857:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98e3e9516e00) 00010000:00010000:0.0:1787836674.935860:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.935863:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935884:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031e00/0x966835ea68ab89da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935923:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030e00/0x966835ea68ab89cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee35e expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935936:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031600/0x966835ea68ab89e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee35e expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.935943:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516700) 00010000:00010000:0.0:1787836674.935945:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787836674.935948:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c0031600, rc 0) 00000100:00100000:0.0:1787836674.936029:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+11:14447:x1874682172265600:12345-192.168.203.25@tcp:101:bash.0 Request processed in 743us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836674.936036:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:3.0:1787836674.940836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.940985:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172265856 00000100:00100000:0.0:1787836674.940995:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172265856 00000100:00100000:0.0:1787836674.941087:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:0.0:1787836674.941098:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+11:14447:x1874682172265856:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1787836674.941128:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836674.941148:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030a00/0x966835ea68ab89e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee365 expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.941306:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.941321:0:15736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 11 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.941339:0:15736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.941374:0:15736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 11 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.941387:0:15736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 11 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836674.941400:0:15736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5caed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193229568:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836674.941505:0:15736:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c4c8dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787836674.945611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836674.945817:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172265984 00000100:00100000:1.0:1787836674.945827:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172265984 00010000:00010000:1.0:1787836674.945869:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 12 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836674.945912:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1787836674.945923:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+12:2363:x1874682172265984:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836674.945939:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836674.945947:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 12 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.945962:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 12 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.945986:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516700) 00010000:00010000:1.0:1787836674.945992:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.946002:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.946011:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.946031:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836674.946153:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7302dfb5-a070-4ecc-a9fd-f6239036f535+12:2363:x1874682172265984:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 232us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836674.946161:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00010000:00010000:0.0:1787836674.946668:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0031200/0x966835ea68ab89c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee357 expref: 11 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836674.946686:0:15736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5caed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193229568:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836674.946707:0:15736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.946716:0:15736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.946723:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.946788:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.946799:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.946814:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948337:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948352:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948361:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836674.948372:0:15736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787836674.948400:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948408:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948414:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948420:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef806400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.948424:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948431:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948443:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516700) 00010000:00010000:0.0:1787836674.948446:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.948462:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948469:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab89ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787836674.948482:0:15736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075cdf4b1 reply state 000000008927c5b8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836674.948490:0:15736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787836674.948529:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c0030a00/0x966835ea68ab89e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 14 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948543:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 13 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.948551:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:0.0:1787836674.948553:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787836674.948556:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef807200, rc 0) 00000100:00100000:0.0:1787836674.948624:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+14:14447:x1874682172265856:12345-192.168.203.25@tcp:101:bash.0 Request processed in 7528us (7797us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787836674.949862:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00010000:00010000:0.0:1787836674.952302:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.952322:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.952330:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.952355:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef806c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836674.952360:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.952368:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.952386:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98e3e9516e00) 00010000:00010000:0.0:1787836674.952389:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836674.952394:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836674.952401:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab89f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836674.963576:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836674.963870:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172266112 00000100:00100000:1.0:1787836674.963880:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172266112 00000100:00100000:1.0:1787836674.963944:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:1.0:1787836674.963954:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+13:14447:x1874682172266112:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1787836674.963978:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836674.964000:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8a0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee36c expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.964256:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8a12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.964271:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.964283:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836674.964321:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787836674.964325:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836674.964346:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.964357:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.964382:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8a0b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee36c expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.964417:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8a12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee36c expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836674.964425:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:1.0:1787836674.964428:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836674.964431:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4e00, rc 0) 00000100:00100000:1.0:1787836674.964547:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+14:14447:x1874682172266112:12345-192.168.203.25@tcp:101:bash.0 Request processed in 595us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836674.964555:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:3.0:1787836674.968851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836674.968910:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172266368 00000100:00100000:0.0:1787836674.968919:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172266368 00000100:00100000:0.0:1787836674.968971:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1787836674.968979:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+14:14447:x1874682172266368:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:0.0:1787836674.969827:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+15:14447:x1874682172266368:12345-192.168.203.25@tcp:35:bash.0 Request processed in 842us (979us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787836674.969838:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:3.0:1787836675.067436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836675.067557:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172266624 00000100:00100000:0.0:1787836675.067566:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172266624 00000100:00100000:0.0:1787836675.067629:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:0.0:1787836675.067639:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+15:14457:x1874682172266624:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836675.067671:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836675.067700:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee373 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836675.067829:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787836675.067959:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee373 expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.067976:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:0.0:1787836675.067979:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787836675.067985:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee373 expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.068000:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef806c00, rc 0) 00000100:00100000:0.0:1787836675.068355:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+16:14457:x1874682172266624:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 717us (927us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787836675.068363:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:1.0:1787836675.072868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836675.073379:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172266880 00000100:00100000:2.0:1787836675.073389:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172266880 00000100:00100000:2.0:1787836675.073448:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1787836675.073476:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+16:14457:x1874682172266880:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:2.0:1787836675.073888:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+17:14457:x1874682172266880:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 414us (1028us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787836675.073897:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1787836675.124858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836675.124968:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172267136 00000100:00100000:0.0:1787836675.124977:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172267136 00000100:00100000:0.0:1787836675.125050:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:0.0:1787836675.125104:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+17:14460:x1874682172267136:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836675.125136:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836675.125157:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a27 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee37a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.125251:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab8a2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.125266:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab8a2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.125291:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab8a2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836675.125303:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787836675.125422:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a27 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee37a expref: 20 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.125442:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab8a2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee37a expref: 19 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.125451:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:0.0:1787836675.125454:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836675.125457:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef806400, rc 0) 00000100:00100000:0.0:1787836675.125524:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+19:14460:x1874682172267136:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 465us (674us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787836675.125531:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:1.0:1787836675.134305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836675.134386:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172267264 00000100:00100000:3.0:1787836675.134395:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172267264 00000100:00100000:3.0:1787836675.134439:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:3.0:1787836675.134447:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+19:14460:x1874682172267264:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:3.0:1787836675.134518:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134535:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134546:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134571:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134578:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134585:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134590:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836675.134595:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134602:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134612:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:3.0:1787836675.134614:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787836675.134631:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.134638:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836675.134813:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+19:14460:x1874682172267264:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 367us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836675.134821:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:3.0:1787836675.137699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836675.137876:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172267392 00000100:00100000:2.0:1787836675.137887:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172267392 00000100:00100000:2.0:1787836675.137954:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:2.0:1787836675.137965:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c604de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+19:2363:x1874682172267392:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836675.138077:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836675.138104:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806400/0x966835ea68ab8a2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee37a expref: 19 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.138135:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:2.0:1787836675.138140:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836675.138195:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c604de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+18:2363:x1874682172267392:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 231us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836675.138321:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:2.0:1787836675.144961:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836675.146831:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172267648 00000100:00100000:0.0:1787836675.146859:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172267648 00000100:00100000:0.0:1787836675.146935:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:0.0:1787836675.146946:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+18:14460:x1874682172267648:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1787836675.147909:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+19:14460:x1874682172267648:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 962us (2955us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787836675.147920:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00010000:00010000:1.0:1787836675.182434:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836675.415879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836675.416013:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172267904 00000100:00100000:0.0:1787836675.416023:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172267904 00000100:00100000:0.0:1787836675.416117:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:0.0:1787836675.416128:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+19:14492:x1874682172267904:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:0.0:1787836675.416167:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836675.416188:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee381 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.416288:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807600/0x966835ea68ab8a4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.416302:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807600/0x966835ea68ab8a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.416315:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807600/0x966835ea68ab8a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836675.416326:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787836675.416478:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee381 expref: 22 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.416497:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807600/0x966835ea68ab8a4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee381 expref: 21 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.416506:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:0.0:1787836675.416509:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836675.416512:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef807600, rc 0) 00000100:00100000:0.0:1787836675.416573:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+21:14492:x1874682172267904:12345-192.168.203.25@tcp:101:cat.0 Request processed in 447us (705us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787836675.416580:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1787836675.422338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836675.422416:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172268160 00000100:00100000:0.0:1787836675.422425:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172268160 00000100:00100000:0.0:1787836675.422490:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:0.0:1787836675.422514:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+21:14492:x1874682172268160:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:0.0:1787836675.422861:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+22:14492:x1874682172268160:12345-192.168.203.25@tcp:35:cat.0 Request processed in 348us (530us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787836675.422870:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1787836675.425541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836675.425637:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172268288 00000100:00100000:3.0:1787836675.425656:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172268288 00000100:00100000:3.0:1787836675.425727:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1787836675.425738:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+22:2363:x1874682172268288:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836675.425754:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836675.425781:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807600/0x966835ea68ab8a4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee381 expref: 22 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.425801:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:3.0:1787836675.425807:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836675.425868:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+21:2363:x1874682172268288:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 133us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836675.425876:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1787836675.522817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836675.523227:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172268544 00000100:00100000:0.0:1787836675.523238:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172268544 00000100:00100000:0.0:1787836675.523308:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:0.0:1787836675.523317:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+21:14498:x1874682172268544:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:0.0:1787836675.523340:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836675.523361:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a58 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee388 expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.523626:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.523640:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.523652:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836675.523663:0:15736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787836675.523995:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a58 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 24 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.524015:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 23 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.524043:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:0.0:1787836675.524046:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836675.524050:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef807c00, rc 0) 00000100:00100000:0.0:1787836675.524197:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+23:14498:x1874682172268544:12345-192.168.203.25@tcp:101:dd.0 Request processed in 879us (1388us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787836675.524205:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:1.0:1787836675.536602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836675.536651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836675.536840:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172268928 00000100:00100000:3.0:1787836675.536849:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172268928 00000100:00100000:3.0:1787836675.536948:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:3.0:1787836675.536972:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c2648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+23:14498:x1874682172268928:12345-192.168.203.25@tcp:36:dd.0 00010000:00010000:3.0:1787836675.537034:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836675.537090:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8a12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee36c expref: 23 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.537119:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:3.0:1787836675.537124:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787836675.537318:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.537332:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 23 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.537341:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.537371:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 23 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.537384:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 23 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836675.537397:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a62580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1874682193229696:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836675.538911:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429000 going to sleep for 11 seconds 00000100:00100000:2.0:1787836675.539149:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172268672 00000100:00100000:2.0:1787836675.539157:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172268672 00010000:00010000:2.0:1787836675.539194:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 24 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836675.539229:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:2.0:1787836675.539239:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c5128450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+24:2363:x1874682172268672:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836675.539267:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836675.539274:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 24 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.539288:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 24 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.539308:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:2.0:1787836675.539313:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.539323:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.539332:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.539347:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836675.539383:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c5128450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+24:2363:x1874682172268672:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 146us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836675.539391:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00010000:00010000:0.0:1787836675.542552:0:14324:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.25@tcp) returned -22 from blocking AST (req@00000000bdaae20c x1874682193229696) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 23 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.542577:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee388 expref: 23 pid: 15736 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836675.542595:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a62580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1874682193229696:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836675.542619:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:0.0:1787836675.542628:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.542637:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836675.542643:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787836675.542767:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787836675.542832:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f74918ee reply state 00000000c9577045 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836675.542855:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787836675.542951:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c2648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+24:14498:x1874682172268928:12345-192.168.203.25@tcp:36:dd.0 Request processed in 5980us (6297us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787836675.542960:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000020:00080000:0.0:1787836675.542965:0:14324:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787836675.553578:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.553599:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.553608:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.553633:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152ac00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836675.553638:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.553647:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.553663:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:2.0:1787836675.553666:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836675.553671:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836675.553678:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a6d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836675.690996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836675.691174:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172269184 00000100:00100000:2.0:1787836675.691184:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172269184 00000100:00100000:2.0:1787836675.691248:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1787836675.691268:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+23:14498:x1874682172269184:12345-192.168.203.25@tcp:35:dd.0 00000100:00100000:2.0:1787836675.691525:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+24:14498:x1874682172269184:12345-192.168.203.25@tcp:35:dd.0 Request processed in 258us (537us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1787836675.691534:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1787836675.972848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836675.973813:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172269312 00000100:00100000:3.0:1787836675.973823:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172269312 00000100:00100000:3.0:1787836675.973898:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:3.0:1787836675.973926:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+24:14512:x1874682172269312:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:3.0:1787836675.973952:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836675.973972:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee38f expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974040:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974110:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974126:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974143:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974151:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974157:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974264:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8a89 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974273:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974281:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787836675.974325:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787836675.974329:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787836675.974364:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974376:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974384:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974391:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974398:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974404:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152ac00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836675.974408:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974416:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974427:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516700) 00010000:00010000:3.0:1787836675.974430:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836675.974434:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974441:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8a7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974465:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974471:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974476:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974481:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836675.974485:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974491:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974499:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98e3c5445a00) 00010000:00010000:3.0:1787836675.974502:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787836675.974505:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974511:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8a82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974542:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8a74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee38f expref: 26 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974556:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8a89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee38f expref: 25 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836675.974576:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:3.0:1787836675.974578:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787836675.974581:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b600, rc 0) 00000100:00100000:3.0:1787836675.974830:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+25:14512:x1874682172269312:12345-192.168.203.25@tcp:101:stat.0 Request processed in 906us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836675.974839:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:3.0:1787836676.078828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.079109:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172269568 00000100:00100000:1.0:1787836676.079120:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172269568 00000100:00100000:1.0:1787836676.079194:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:1.0:1787836676.079205:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+25:14518:x1874682172269568:12345-192.168.203.25@tcp:36:truncate.0 00010000:00010000:1.0:1787836676.079280:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836676.079312:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b600/0x966835ea68ab8a89 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee38f expref: 25 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.079334:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:1.0:1787836676.079339:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836676.079568:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.079600:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.079610:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787836676.079913:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787836676.080195:0:14325:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787836676.080228:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019fa8d51 reply state 00000000f90d7f85 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836676.080238:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836676.080380:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+27:14518:x1874682172269568:12345-192.168.203.25@tcp:36:truncate.0 Request processed in 1175us (1560us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787836676.080388:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00000020:00080000:1.0:1787836676.080394:0:14325:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787836676.084989:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.085005:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.085013:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.085019:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836676.085023:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.085031:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.085051:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:0.0:1787836676.085054:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836676.085085:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.085093:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8a90 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.208923:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787836676.286021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.286438:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172269696 00000100:00100000:0.0:1787836676.286471:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172269696 00000100:00100000:0.0:1787836676.286538:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:0.0:1787836676.286548:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+26:14532:x1874682172269696:12345-192.168.203.25@tcp:101:stat.0 00010000:00010000:0.0:1787836676.286573:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836676.286595:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a97 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee396 expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286701:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286718:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286729:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286745:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286752:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286758:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286875:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286884:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.286892:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836676.286942:0:15736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787836676.286948:0:15736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836676.286990:0:15736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287004:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287012:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287018:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287024:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287030:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef806c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836676.287034:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287042:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287055:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516700) 00010000:00010000:0.0:1787836676.287092:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836676.287097:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287114:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806c00/0x966835ea68ab8a9e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287139:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287145:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287151:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287156:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef807800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836676.287158:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287164:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287173:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98e3e9516e00) 00010000:00010000:0.0:1787836676.287176:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836676.287179:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287185:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8aa5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287220:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8a97 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 28 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287236:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 27 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.287254:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:0.0:1787836676.287256:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787836676.287259:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef807a00, rc 0) 00000100:00100000:0.0:1787836676.287334:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+27:14532:x1874682172269696:12345-192.168.203.25@tcp:101:stat.0 Request processed in 787us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836676.287342:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:1.0:1787836676.408929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.409037:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172269952 00000100:00100000:0.0:1787836676.409047:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172269952 00000100:00100000:0.0:1787836676.409158:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:0.0:1787836676.409169:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c26483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+27:14542:x1874682172269952:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1787836676.409191:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836676.409210:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee39d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836676.409319:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787836676.409437:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8ab3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee39d expref: 29 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.409453:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:0.0:1787836676.409456:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787836676.409461:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee39d expref: 29 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.409476:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef807c00, rc 0) 00000100:00100000:0.0:1787836676.409541:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c26483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+28:14542:x1874682172269952:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 374us (624us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1787836676.409562:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1787836676.414360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.423345:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172270208 00000100:00100000:0.0:1787836676.423361:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172270208 00000100:00100000:0.0:1787836676.423435:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:0.0:1787836676.423445:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3ee8d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+28:14542:x1874682172270208:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1787836676.424861:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3ee8d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+29:14542:x1874682172270208:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 1409us (10500us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787836676.424873:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1787836676.502360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.502473:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172270464 00000100:00100000:0.0:1787836676.502482:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172270464 00000100:00100000:0.0:1787836676.502545:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:0.0:1787836676.502556:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+29:14548:x1874682172270464:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1787836676.502581:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836676.502600:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8ac1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3a4 expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.502710:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.502725:0:15736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 30 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.502734:0:15736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 30 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.502743:0:15736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.502790:0:15736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 30 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.502804:0:15736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 30 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.502818:0:15736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5caed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193229824:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836676.502919:0:15736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 30 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.502929:0:15736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 30 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.502950:0:15736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cac780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193229952:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836676.502974:0:15736:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0cf0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787836676.511874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.511915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836676.511998:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172270592 00000100:00100000:3.0:1787836676.512009:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172270592 00010000:00010000:3.0:1787836676.512106:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 31 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.512241:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172270720 00000100:00100000:3.0:1787836676.512245:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172270720 00010000:00010000:3.0:1787836676.512261:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 32 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.512347:0:15736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5caed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193229824:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836676.512359:0:15736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cac780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193229952:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836676.512381:0:15736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836676.512480:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:1.0:1787836676.512492:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c264b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:2364:x1874682172270592:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836676.512509:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836676.512516:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 32 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512529:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 32 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512572:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807a00/0x966835ea68ab8aac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee396 expref: 32 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512587:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:1.0:1787836676.512592:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512600:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512606:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836676.512665:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:2364:x1874682172270592:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 176us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.512672:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:1.0:1787836676.512689:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:1.0:1787836676.512695:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+30:2364:x1874682172270720:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836676.512703:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836676.512708:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 30 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512718:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 30 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512729:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807200/0x966835ea68ab89fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee365 expref: 30 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512748:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:1.0:1787836676.512752:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512760:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512767:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512789:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836676.512808:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+29:2364:x1874682172270720:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 113us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.512813:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00010000:00010000:1.0:1787836676.512842:0:15736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.512849:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836676.512866:0:15736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1787836676.513035:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807c00/0x966835ea68ab8ac1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 30 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.513051:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 29 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.513116:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:1.0:1787836676.513125:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787836676.513128:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef807800, rc 0) 00000100:00100000:1.0:1787836676.513153:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c264a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+29:14548:x1874682172270464:12345-192.168.203.25@tcp:101:bash.0 Request processed in 10600us (10802us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1787836676.513161:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:2.0:1787836676.523809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.523932:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172270976 00000100:00100000:0.0:1787836676.523943:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172270976 00000100:00100000:0.0:1787836676.524003:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:0.0:1787836676.524014:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+29:14548:x1874682172270976:12345-192.168.203.25@tcp:36:bash.0 00010000:00010000:0.0:1787836676.524329:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.524359:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.524369:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787836676.524429:0:14325:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1787836676.524456:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000771bf5db reply state 00000000b5b02868 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.524465:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787836676.524553:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14548:x1874682172270976:12345-192.168.203.25@tcp:36:bash.0 Request processed in 540us (753us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787836676.524564:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000020:00080000:0.0:1787836676.524574:0:14325:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787836676.530290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836676.532403:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172271104 00000100:00100000:3.0:1787836676.532415:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172271104 00000100:00100000:3.0:1787836676.532482:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:3.0:1787836676.532491:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14548:x1874682172271104:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836676.532515:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836676.532535:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8add lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3ab expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.532610:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8add lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ab expref: 33 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.532625:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8add lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ab expref: 33 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.532654:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:3.0:1787836676.532657:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836676.532662:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b200, rc 0) 00000100:00100000:3.0:1787836676.532726:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+33:14548:x1874682172271104:12345-192.168.203.25@tcp:101:bash.0 Request processed in 236us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836676.532734:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00010000:00010000:2.0:1787836676.538616:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.538633:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.538783:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.538790:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef806e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836676.538795:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.538804:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.538824:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:2.0:1787836676.538873:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836676.538879:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.538887:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806e00/0x966835ea68ab8ad6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836676.542373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.542456:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172271232 00000100:00100000:0.0:1787836676.542465:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172271232 00000100:00100000:0.0:1787836676.542517:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:0.0:1787836676.542526:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14548:x1874682172271232:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1787836676.542544:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787836676.542562:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806200/0x966835ea68ab8ae4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3b2 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.542636:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.542658:0:14325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 33 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.542685:0:14325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.542717:0:14325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 33 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.542730:0:14325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 33 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.542743:0:14325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5caed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1874682193230080:192.168.203.25@tcp:104: 00000100:00100000:0.0:1787836676.542821:0:14325:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0cf0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787836676.547500:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836676.551194:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172271360 00000100:00100000:2.0:1787836676.551209:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172271360 00010000:00010000:2.0:1787836676.551257:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 34 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836676.551396:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1787836676.551423:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+34:2363:x1874682172271360:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787836676.551447:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787836676.551455:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 34 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.551513:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 34 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.551548:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:2.0:1787836676.551553:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.551572:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.551581:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.551612:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787836676.551721:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+34:2363:x1874682172271360:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 307us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836676.551730:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00010000:00010000:1.0:1787836676.554018:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807800/0x966835ea68ab8ac8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3a4 expref: 33 pid: 15736 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836676.554085:0:14325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5caed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14325:1874682193230080:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836676.554133:0:14325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.554144:0:14325:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.554150:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836676.554195:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787836676.554200:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836676.554219:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.554250:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806200/0x966835ea68ab8ae4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b2 expref: 33 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.554264:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b2 expref: 32 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.554294:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:1.0:1787836676.554297:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836676.554300:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ef806800, rc 0) 00000100:00100000:1.0:1787836676.554361:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14548:x1874682172271232:12345-192.168.203.25@tcp:101:bash.0 Request processed in 11835us (11995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.554369:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:0.0:1787836676.562424:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.562637:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172271616 00000100:00100000:1.0:1787836676.562647:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172271616 00000100:00100000:1.0:1787836676.562717:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:1.0:1787836676.562726:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14548:x1874682172271616:12345-192.168.203.25@tcp:103:bash.0 00010000:00010000:1.0:1787836676.562742:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787836676.562767:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8aeb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b2 expref: 32 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.562786:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8add lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ab expref: 31 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.562796:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3e9516100) 00010000:00010000:1.0:1787836676.562807:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836676.562852:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+30:14548:x1874682172271616:12345-192.168.203.25@tcp:103:bash.0 Request processed in 128us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.562860:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:0.0:1787836676.565633:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836676.565835:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172271744 00000100:00100000:3.0:1787836676.565845:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172271744 00000100:00100000:3.0:1787836676.565903:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:3.0:1787836676.565913:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+30:14548:x1874682172271744:12345-192.168.203.25@tcp:58:bash.0 00010000:00010000:3.0:1787836676.566030:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.566046:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.566199:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787836676.569297:0:14323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787836676.569565:0:14323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787836676.570303:0:14323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787836676.570516:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+30:14548:x1874682172271744:12345-192.168.203.25@tcp:58:bash.0 Request processed in 4597us (4886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836676.570532:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:0.0:1787836676.577044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836676.584209:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172271872 00000100:00100000:3.0:1787836676.584227:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172271872 00000100:00100000:3.0:1787836676.584379:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1787836676.584389:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+30:14548:x1874682172271872:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836676.584409:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836676.584430:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8af9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3b9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.584484:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.584495:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8af9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b9 expref: 31 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.584514:0:14324:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.584526:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8af9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b9 expref: 31 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.584538:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3c5445a00) 00010000:00010000:3.0:1787836676.584541:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836676.584544:0:14324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8af9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b9 expref: 31 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.584551:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152ac00, rc 0) 00000100:00100000:3.0:1787836676.584609:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:14548:x1874682172271872:12345-192.168.203.25@tcp:101:bash.0 Request processed in 222us (7576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836676.584617:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000040:00080000:2.0:1787836676.594755:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787836676.594764:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787836676.594797:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787836676.594803:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787836676.595039:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5ee9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14357:1874682193230208:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787836676.595241:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c60f06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787836676.597232:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5ee9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14357:1874682193230208:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787836676.598954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836676.599094:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172272000 00000100:00100000:2.0:1787836676.599113:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172272000 00000100:00100000:2.0:1787836676.599157:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:2.0:1787836676.599181:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:14549:x1874682172272000:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787836676.599266:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:14549:x1874682172272000:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 Request processed in 88us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836676.599274:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:0.0:1787836676.601182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.601264:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172272128 00000100:00100000:1.0:1787836676.601272:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172272128 00000100:00100000:1.0:1787836676.601329:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:1.0:1787836676.601352:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:14549:x1874682172272128:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787836676.601384:0:15736:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787836676.601498:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:14549:x1874682172272128:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 147us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.601505:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:1.0:1787836676.604171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.604255:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172272256 00000100:00100000:0.0:1787836676.604265:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172272256 00000100:00100000:0.0:1787836676.604323:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:0.0:1787836676.604332:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:14549:x1874682172272256:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787836676.604417:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604434:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604448:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604525:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604533:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604540:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604562:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604570:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604576:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787836676.604611:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787836676.604616:0:14325:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787836676.604627:0:14325:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604644:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604658:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604665:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604672:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef807400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836676.604676:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604684:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604697:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3e9516600) 00010000:00010000:0.0:1787836676.604700:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836676.604704:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604710:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef807400/0x966835ea68ab8b00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604721:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604727:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604732:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604737:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef806600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836676.604745:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604751:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604759:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98e3e9516e00) 00010000:00010000:0.0:1787836676.604761:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836676.604764:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604770:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604784:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604790:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604796:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604801:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef806800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836676.604804:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604810:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604817:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3c5445a00) 00010000:00010000:0.0:1787836676.604819:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836676.604828:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.604834:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.604913:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:14549:x1874682172272256:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 581us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836676.604922:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:2.0:1787836676.608262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.608350:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172272512 00000100:00100000:1.0:1787836676.608359:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172272512 00000100:00100000:1.0:1787836676.608406:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:1.0:1787836676.608415:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+31:14549:x1874682172272512:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836676.608436:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836676.608462:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3c0 expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608547:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608561:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608571:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836676.608581:0:15736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787836676.608673:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608680:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608702:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608709:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836676.608713:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608721:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608732:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3c5445a00) 00010000:00010000:1.0:1787836676.608736:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787836676.608740:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608747:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608786:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b15 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3c0 expref: 33 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608796:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98e3e9516600) 00010000:00010000:1.0:1787836676.608798:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836676.608802:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3c0 expref: 33 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.608810:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4c00, rc 0) 00000100:00100000:1.0:1787836676.608870:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14549:x1874682172272512:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 456us (617us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1787836676.608888:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:1.0:1787836676.611704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.611786:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172272640 00000100:00100000:0.0:1787836676.611795:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172272640 00000100:00100000:0.0:1787836676.611853:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:0.0:1787836676.611863:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14549:x1874682172272640:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787836676.611898:0:14325:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787836676.612014:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14549:x1874682172272640:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 144us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836676.612022:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:2.0:1787836676.614814:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.614895:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172272896 00000100:00100000:1.0:1787836676.614905:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172272896 00000100:00100000:1.0:1787836676.614964:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:1.0:1787836676.614974:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+32:14549:x1874682172272896:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836676.614993:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836676.615024:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b2a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3c7 expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787836676.615651:0:15736:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1787836676.615658:0:15736:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1787836676.615705:0:15736:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787836676.615934:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.615949:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.615962:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.616018:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b2a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3c7 expref: 35 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.616037:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3c7 expref: 34 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.616109:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:1.0:1787836676.616113:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787836676.616117:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5a00, rc 0) 00000100:00100000:1.0:1787836676.616193:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+34:14549:x1874682172272896:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1220us (1387us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787836676.616201:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:2.0:1787836676.619712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.619819:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172273152 00000100:00100000:0.0:1787836676.619828:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172273152 00000100:00100000:0.0:1787836676.619889:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:0.0:1787836676.619899:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+34:14549:x1874682172273152:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787836676.619964:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836676.619996:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3c7 expref: 34 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620017:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431500) 00010000:00010000:0.0:1787836676.620029:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787836676.620054:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620214:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620226:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620244:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620260:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620268:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620342:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620349:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620355:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620361:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef806800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836676.620365:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620371:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620379:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516700) 00010000:00010000:0.0:1787836676.620388:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836676.620393:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620398:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806800/0x966835ea68ab8b3f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620409:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620413:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620418:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620422:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ef806600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1787836676.620424:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620429:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620435:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x29f1c12c (ffff98e3e9516e00) 00010000:00010000:0.0:1787836676.620437:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787836676.620439:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.620444:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ef806600/0x966835ea68ab8b46 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x29f1c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.620566:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+33:14549:x1874682172273152:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 667us (864us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787836676.620579:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:3.0:1787836676.626645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.627673:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172273280 00000100:00100000:1.0:1787836676.627685:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172273280 00000100:00100000:1.0:1787836676.627749:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1787836676.627859:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+33:14549:x1874682172273280:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836676.627881:0:15736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836676.627904:0:15736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b4d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3ce expref: -99 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.627952:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8b54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.627966:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.627978:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.629191:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ce expref: 35 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.629216:0:15736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4e00/0x966835ea68ab8b54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ce expref: 34 pid: 15736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.629238:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:1.0:1787836676.629241:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787836676.629245:0:15736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f4e00, rc 0) 00000100:00100000:1.0:1787836676.629363:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+34:14549:x1874682172273280:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1604us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.629372:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:2.0:1787836676.651089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836676.651220:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172273536 00000100:00100000:3.0:1787836676.651232:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172273536 00000100:00100000:3.0:1787836676.651291:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:3.0:1787836676.651301:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+34:14549:x1874682172273536:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787836676.651385:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.651402:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.651414:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787836676.651907:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787836676.651919:0:14324:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 525084860254ns, next at 526084857612ns, rc = 0 00000004:00010000:3.0:1787836676.652010:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9b3b94e reply state 00000000c87ee2f4 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.652021:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787836676.652467:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+36:14549:x1874682172273536:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 1164us (1382us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787836676.652476:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:0.0:1787836676.658222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.658861:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172273664 00000100:00100000:1.0:1787836676.658873:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172273664 00000100:00100000:1.0:1787836676.658956:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1787836676.658967:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+36:14549:x1874682172273664:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836676.658992:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836676.659013:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3d5 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.659126:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 37 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.659144:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 37 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.659164:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:1.0:1787836676.659167:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787836676.659171:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5e00, rc 0) 00000100:00100000:1.0:1787836676.659234:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+37:14549:x1874682172273664:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 269us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.659258:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00010000:00010000:3.0:1787836676.660305:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.660321:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.660328:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.660349:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836676.660353:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.660362:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.660377:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:3.0:1787836676.660380:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787836676.660385:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.660391:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152b200/0x966835ea68ab8b5b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836676.661889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.662107:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172273792 00000100:00100000:0.0:1787836676.662116:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172273792 00000100:00100000:0.0:1787836676.662183:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:0.0:1787836676.662193:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2363:x1874682172273792:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787836676.662561:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadc03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2363:x1874682172273792:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 368us (683us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787836676.662569:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00080000:3.0:1787836676.666184:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787836676.667742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.667873:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172274048 00000100:00100000:0.0:1787836676.667883:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172274048 00000100:00100000:0.0:1787836676.667944:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:0.0:1787836676.667954:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+36:14549:x1874682172274048:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787836676.668226:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+37:14549:x1874682172274048:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 272us (490us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787836676.668233:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:0.0:1787836676.677719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.677937:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172274304 00000100:00100000:1.0:1787836676.677947:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172274304 00000100:00100000:1.0:1787836676.677999:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:1.0:1787836676.678008:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+37:14549:x1874682172274304:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787836676.678156:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+37:14549:x1874682172274304:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 148us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.678163:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:3.0:1787836676.680864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.681088:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172274432 00000100:00100000:1.0:1787836676.681107:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172274432 00000100:00100000:1.0:1787836676.681164:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1787836676.681174:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+37:14549:x1874682172274432:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787836676.681193:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836676.681216:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b69 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3dc expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.681313:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8b70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.681327:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.681339:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836676.681383:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787836676.681400:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.681423:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b69 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3dc expref: 39 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.681439:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8b70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3dc expref: 38 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.681447:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:1.0:1787836676.681450:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787836676.681453:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5800, rc 0) 00000100:00100000:1.0:1787836676.681523:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+38:14549:x1874682172274432:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 350us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.681531:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:2.0:1787836676.688323:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836676.688445:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172274560 00000100:00100000:3.0:1787836676.688466:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172274560 00000100:00100000:3.0:1787836676.688514:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:3.0:1787836676.688524:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+6:2364:x1874682172274560:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836676.688541:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836676.688559:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3e3 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836676.688586:0:15008:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a903903, blocks: 0x1 00010000:00010000:3.0:1787836676.688607:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787836676.688612:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836676.688651:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 7 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.688671:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 7 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.688684:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b600, rc 0) 00000100:00100000:3.0:1787836676.688745:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eeb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:2364:x1874682172274560:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 222us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836676.688752:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:2.0:1787836676.705247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.705342:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172274816 00000100:00100000:1.0:1787836676.705353:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172274816 00000100:00100000:1.0:1787836676.705409:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:1.0:1787836676.705419:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+38:14549:x1874682172274816:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787836676.705528:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+38:14549:x1874682172274816:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.705535:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:1.0:1787836676.722564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.722666:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172274944 00000100:00100000:0.0:1787836676.722675:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172274944 00000100:00100000:0.0:1787836676.722728:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:0.0:1787836676.722737:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+38:14549:x1874682172274944:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787836676.788625:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:0.0:1787836676.788681:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787836676.788706:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:0.0:1787836676.788724:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787836676.789148:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787836676.789170:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193230336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787836676.789246:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836676.789448:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193230336 00000100:00100000:2.0:1787836676.789464:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193230336 00000100:00100000:2.0:1787836676.789526:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787836676.789535:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193230336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787836676.789708:0:15009:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787836676.789712:0:15009:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787836676.789715:0:15009:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787836676.789717:0:15009:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787836675 -> 1787836675 00002000:00010000:2.0:1787836676.789719:0:15009:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787836676.789763:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874682193230336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (516us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787836676.789771:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1787836676.789813:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98e3f5eea580/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787836676.789818:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5eea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193230336:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1787836676.790022:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836676.792973:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+13:14549:x1874682172274944:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 70225us (70407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836676.793003:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:2.0:1787836676.796084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.796485:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172275072 00000100:00100000:0.0:1787836676.796495:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172275072 00000100:00100000:0.0:1787836676.796555:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1787836676.796565:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:2363:x1874682172275072:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787836676.796681:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:2363:x1874682172275072:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 117us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836676.796689:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1787836676.798942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.799041:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172275328 00000100:00100000:1.0:1787836676.799050:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172275328 00000100:00100000:1.0:1787836676.799140:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:1.0:1787836676.799150:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5caf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+13:14549:x1874682172275328:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787836676.799199:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836676.799225:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5800/0x966835ea68ab8b70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3dc expref: 13 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.799243:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:1.0:1787836676.799248:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787836676.799277:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.799290:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.799300:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787836676.799494:0:14325:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d776f05 reply state 00000000c828b534 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836676.799505:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787836676.799601:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5caf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+14:14549:x1874682172275328:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 453us (668us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1787836676.799608:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:1.0:1787836676.802541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00010000:00010000:2.0:1787836676.802699:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.802710:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.802718:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.802723:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836676.802728:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.802735:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.802749:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:2.0:1787836676.802752:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836676.802757:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.802763:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5c00/0x966835ea68ab8b7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.802987:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172275456 00000100:00100000:3.0:1787836676.802997:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172275456 00000100:00100000:3.0:1787836676.803052:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1787836676.803089:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:14549:x1874682172275456:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787836676.803116:0:15008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836676.803132:0:15008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3ea expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.803160:0:15008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 8 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.803168:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836676.803173:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836676.803177:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 8 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.803223:0:15008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 8 pid: 15008 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.803235:0:15008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 8 pid: 15008 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.803248:0:15008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a63840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15008:1874682193230464:192.168.203.25@tcp:104: 00000100:00100000:3.0:1787836676.803327:0:15008:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836676.808799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836676.808944:0:15008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a63840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15008:1874682193230464:192.168.203.25@tcp:104: 00010000:00010000:3.0:1787836676.808978:0:15008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 8 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.809001:0:15008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b200, rc 0) 00000100:00100000:3.0:1787836676.809084:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+8:14549:x1874682172275456:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 5973us (6527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836676.809093:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:0.0:1787836676.809589:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172275584 00000100:00100000:0.0:1787836676.809596:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172275584 00010000:00010000:0.0:1787836676.809629:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 8 pid: 15008 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.809677:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1787836676.809686:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+8:2363:x1874682172275584:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787836676.809699:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787836676.809720:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 8 pid: 15008 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.809732:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 8 pid: 15008 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.809754:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3e3 expref: 8 pid: 15008 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.809769:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836676.809785:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787836676.809793:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 7 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.809803:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 7 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.809838:0:14311:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 7 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.809850:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3f5cae1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14311:1874682193230592:192.168.203.25@tcp:105: 00000100:00100000:0.0:1787836676.809920:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d0cf0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787836676.812722:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3f5cae1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14311:1874682193230592:192.168.203.25@tcp:105: 00010000:00010000:0.0:1787836676.812750:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787836676.812803:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5eea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:2363:x1874682172275584:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 3118us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836676.812814:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:2.0:1787836676.814660:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.814749:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172275712 00000100:00100000:1.0:1787836676.814757:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172275712 00000100:00100000:1.0:1787836676.814812:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1787836676.814822:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5ee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:2363:x1874682172275712:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787836676.815010:0:15009:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787836676.815014:0:15009:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787836675 00002000:00010000:1.0:1787836676.815017:0:15009:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787836674 00002000:00010000:1.0:1787836676.815019:0:15009:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787836675 -> 1787836675 00002000:00010000:1.0:1787836676.815021:0:15009:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787836676.815114:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5ee9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+8:2363:x1874682172275712:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 293us (462us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787836676.815122:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1787836676.817689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1787836676.817776:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172275840 00000100:00100000:3.0:1787836676.817785:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172275840 00000100:00100000:3.0:1787836676.817842:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1787836676.817852:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+8:2364:x1874682172275840:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787836676.817892:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.817929:0:15008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 8 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.817939:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836676.817943:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836676.817948:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.817982:0:15008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 8 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.817996:0:15008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 8 pid: 15008 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.818017:0:15008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a63840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15008:1874682193230720:192.168.203.25@tcp:104: 00000100:00100000:2.0:1787836676.826183:0:15008:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429180 going to sleep for 11 seconds 00000100:00100000:2.0:1787836676.836884:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.838402:0:15008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a63840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15008:1874682193230720:192.168.203.25@tcp:104: 00010000:00010000:0.0:1787836676.838430:0:15008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.842572:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172275968 00000100:00100000:3.0:1787836676.842587:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172275968 00010000:00010000:3.0:1787836676.843586:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 9 pid: 15008 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.843730:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1787836676.843753:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+9:2364:x1874682172275968:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787836676.843775:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787836676.843805:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 9 pid: 15008 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.843836:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 9 pid: 15008 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.843863:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8b85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3ea expref: 9 pid: 15008 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.843882:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836676.843887:0:14310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787836676.843892:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.843904:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.843948:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787836676.844025:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+8:2364:x1874682172275968:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 284us (7152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836676.844032:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00010000:00010000:0.0:1787836676.846123:0:15008:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.846144:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.846198:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.846206:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.846214:0:15008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.846222:0:15008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152b600 already unused, calling callback (ffffffffc1594500) 00010000:00010000:0.0:1787836676.846226:0:15008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.846234:0:15008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.846264:0:15008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787836676.846273:0:15008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386fab70/0x966835ea68ab8b8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.846374:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:2364:x1874682172275840:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 28517us (28691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836676.846392:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:0.0:1787836676.856192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.856432:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172276224 00000100:00100000:1.0:1787836676.856442:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172276224 00000100:00100000:1.0:1787836676.856622:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1787836676.856633:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+13:14549:x1874682172276224:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787836676.856790:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.856807:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.856819:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.857435:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.857523:0:15736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 14 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.857532:0:15736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.857565:0:15736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 14 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.857580:0:15736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 14 pid: 14323 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836676.857595:0:15736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dded00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193230848:192.168.203.25@tcp:104: 00000100:00100000:1.0:1787836676.857761:0:15736:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d09813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787836676.866924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.867682:0:15736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dded00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193230848:192.168.203.25@tcp:104: 00010000:00010000:1.0:1787836676.867716:0:15736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.868546:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172276352 00000100:00100000:3.0:1787836676.868556:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172276352 00010000:00010000:3.0:1787836676.868598:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 15 pid: 14323 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787836676.868736:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1787836676.868748:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c512a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+15:2364:x1874682172276352:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787836676.868763:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787836676.868771:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 15 pid: 14323 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.868784:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 15 pid: 14323 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.868826:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8b62 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3d5 expref: 15 pid: 14323 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.868842:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:1.0:1787836676.868847:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.868868:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.868875:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.868900:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787836676.869432:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c512a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+14:2364:x1874682172276352:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 683us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.869441:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00010000:00010000:1.0:1787836676.869597:0:15736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.869606:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787836676.869807:0:15736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1787836676.870411:0:15736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1787836676.870627:0:15736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1787836676.870732:0:15736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dded00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15736:1874682193230976:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787836676.871052:0:15736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836676.871199:0:15736:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3d06d10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787836676.871438:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193230976 00000100:00100000:1.0:1787836676.871446:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193230976 00000100:00100000:1.0:1787836676.871566:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836676.871576:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15736:x1874682193230976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787836676.871675:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15736:x1874682193230976:12345-0@lo:1000:mdt00_003.0 Request processed in 100us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836676.871682:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787836676.871730:0:15736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dded00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15736:1874682193230976:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787836676.876164:0:15736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1787836676.876395:0:15736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3dded00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15736:1874682193231104:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787836676.876528:0:15736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836676.876565:0:15736:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e3c1254b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787836676.876962:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193231104 00000100:00100000:2.0:1787836676.876979:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193231104 00000100:00100000:2.0:1787836676.877042:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787836676.877052:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15736:x1874682193231104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787836676.877443:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15736:x1874682193231104:12345-0@lo:1000:mdt00_003.0 Request processed in 391us (914us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787836676.877450:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787836676.877624:0:15736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3dded00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15736:1874682193231104:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787836676.877675:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877693:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877701:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877707:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836676.877711:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877719:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877734:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:3.0:1787836676.877737:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836676.877742:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877748:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5a00/0x966835ea68ab8b9a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877777:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877782:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877787:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877792:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3c152a600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1787836676.877800:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877806:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877814:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3c5445a00) 00010000:00010000:3.0:1787836676.877816:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787836676.877822:0:15736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8af9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b9 expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877834:0:15736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8af9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b9 expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877844:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8af9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b9 expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.877874:0:15736:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152ac00/0x966835ea68ab8af9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3b9 expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787836676.877886:0:15736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193231232:192.168.203.25@tcp:105: 00000100:00100000:3.0:1787836676.877965:0:15736:0:(client.c:2715:ptlrpc_set_wait()) set ffff98e2c3429180 going to sleep for 11 seconds 00000100:00100000:3.0:1787836676.883177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.883396:0:15736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a621c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15736:1874682193231232:192.168.203.25@tcp:105: 00010000:00010000:1.0:1787836676.883422:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883434:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3c152a600/0x966835ea68ab8af2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.883458:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172276480 00010000:00010000:1.0:1787836676.883466:0:15736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.883468:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172276480 00010000:00010000:1.0:1787836676.883483:0:15736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883495:0:15736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883506:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883527:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883535:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.883536:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00010000:00010000:1.0:1787836676.883546:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f5e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836676.883553:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.883553:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+18:14548:x1874682172276480:12345-192.168.203.25@tcp:49:bash.0 00010000:00010000:1.0:1787836676.883568:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883579:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3c5445a00) 00010000:00010000:1.0:1787836676.883583:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787836676.883586:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883593:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8ba1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883602:0:15736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883608:0:15736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883614:0:15736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883618:0:15736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1787836676.883628:0:15736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883635:0:15736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883651:0:15736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3c5445a00) 00010000:00010000:1.0:1787836676.883654:0:15736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787836676.883657:0:15736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.883664:0:15736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8b93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787836676.883709:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+18:14548:x1874682172276480:12345-192.168.203.25@tcp:49:bash.0 Request processed in 160us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836676.883718:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:1.0:1787836676.883866:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9b6c886-a12b-46a3-a789-dc548bbc30a4+17:14549:x1874682172276224:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 27234us (27681us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1787836676.883876:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000020:00080000:1.0:1787836676.883880:0:15736:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787836676.884179:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787836676.884184:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787836676.884219:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787836676.884225:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787836676.891626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836676.891679:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836676.891830:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172276864 00000100:00100000:1.0:1787836676.891840:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172276864 00000100:00100000:1.0:1787836676.891911:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:1.0:1787836676.891922:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+17:14549:x1874682172276864:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787836676.892816:0:14327:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787836676.892930:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1787836676.892986:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.893006:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.893020:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.893036:0:14327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.893043:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.893049:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836676.893726:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787836676.893847:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+19:14549:x1874682172276864:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 1924us (2164us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1787836676.893858:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000020:00080000:1.0:1787836676.893865:0:14327:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787836676.894500:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172276608 00000100:00100000:3.0:1787836676.894510:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172276608 00000100:00100000:3.0:1787836676.894562:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:3.0:1787836676.894571:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5cad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+7:14548:x1874682172276608:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1787836676.894585:0:15007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787836676.894614:0:15007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8baf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3f1 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787836676.894639:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a903903, atime: 0x6a903902, ctime: 0x6a903903, blocks: 0x1 00010000:00010000:3.0:1787836676.894659:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787836676.894664:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787836676.894674:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3f1 expref: 8 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.894691:0:15007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000927da5b9/0x966835ea68ab8baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3f1 expref: 8 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787836676.894703:0:15007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3c152b200, rc 0) 00000100:00100000:3.0:1787836676.894750:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5cad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+8:14548:x1874682172276608:12345-192.168.203.25@tcp:101:bash.0 Request processed in 181us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836676.894757:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00010000:00010000:2.0:1787836676.895285:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787836676.895295:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.895304:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e3ce1f4c00 already unused, calling callback (ffffffffc1594500) 00010000:00010000:2.0:1787836676.895308:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.895318:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.895332:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98e3d1431100) 00010000:00010000:2.0:1787836676.895335:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787836676.895339:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.895345:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f4c00/0x966835ea68ab8ba8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836676.895358:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836676.895359:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787836676.895361:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836676.899785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836676.901556:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172277120 00000100:00100000:2.0:1787836676.901571:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172277120 00000100:00100000:2.0:1787836676.901773:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1787836676.901799:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+19:14548:x1874682172277120:12345-192.168.203.25@tcp:35:bash.0 00000001:00080000:2.0:1787836676.902129:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1787836676.902223:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1787836676.902345:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+22:14548:x1874682172277120:12345-192.168.203.25@tcp:35:bash.0 Request processed in 547us (2568us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1787836676.902354:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000020:00080000:2.0:1787836676.902359:0:14326:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787836677.033521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836677.033614:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172277376 00000100:00100000:1.0:1787836677.033627:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172277376 00000100:00100000:1.0:1787836677.033702:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:1.0:1787836677.033712:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+22:14559:x1874682172277376:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:1.0:1787836677.033736:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787836677.033755:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8bb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5f21f1b8000ee3f8 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787836677.034017:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787836677.034711:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8bb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3f8 expref: 24 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836677.034732:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98e3e9516500) 00010000:00010000:1.0:1787836677.034735:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787836677.034751:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e3ce1f5e00/0x966835ea68ab8bb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x5f21f1b8000ee3f8 expref: 24 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787836677.034766:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98e3ce1f5e00, rc 0) 00000100:00100000:1.0:1787836677.034838:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9b6c886-a12b-46a3-a789-dc548bbc30a4+23:14559:x1874682172277376:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1128us (1331us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1787836677.034847:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:3.0:1787836677.042235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836677.042355:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172277504 00000100:00100000:2.0:1787836677.042365:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172277504 00000100:00100000:2.0:1787836677.042430:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:2.0:1787836677.042441:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3a621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+23:14559:x1874682172277504:12345-192.168.203.25@tcp:34:lfs.0 00010000:00010000:2.0:1787836677.042517:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.042534:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.042546:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.042560:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.042568:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.042761:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043387:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043414:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043423:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787836677.043464:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043476:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043482:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043489:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043494:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e40216d400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836677.043498:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043505:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043517:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98e3e9516700) 00010000:00010000:2.0:1787836677.043519:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836677.043524:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043530:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216d400/0x966835ea68ab8bc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043553:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043559:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043565:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043571:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e40216c200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836677.043585:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043592:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043600:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98e3d8034f00) 00010000:00010000:2.0:1787836677.043603:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836677.043606:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043611:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c200/0x966835ea68ab8bcb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043626:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043632:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043636:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043649:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98e40216c600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1787836677.043652:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043658:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043666:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98e3c5445a00) 00010000:00010000:2.0:1787836677.043668:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787836677.043671:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787836677.043676:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98e40216c600/0x966835ea68ab8bd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787836677.043953:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3a621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9b6c886-a12b-46a3-a789-dc548bbc30a4+23:14559:x1874682172277504:12345-192.168.203.25@tcp:34:lfs.0 Request processed in 1508us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836677.043963:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:0.0:1787836677.052367:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1787836677.052463:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172277760 00000100:00100000:1.0:1787836677.052473:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172277760 00000100:00100000:1.0:1787836677.052579:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:1.0:1787836677.052589:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+23:14559:x1874682172277760:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:1.0:1787836677.053049:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+24:14559:x1874682172277760:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 460us (690us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1787836677.053088:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00010000:00010000:3.0:1787836677.231476:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836677.741616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836677.741665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1787836677.741721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836677.741779:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172278144 00000100:00100000:0.0:1787836677.741788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836677.741792:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172278144 00000100:00100000:2.0:1787836677.741860:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172278400 00000100:00100000:0.0:1787836677.741860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1787836677.741865:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172278400 00000100:00100000:2.0:1787836677.741891:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172278016 00000100:00100000:2.0:1787836677.741894:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172278016 00000100:00100000:2.0:1787836677.741911:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836677.741921:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c378a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2361:x1874682172278144:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1787836677.741938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00080000:0.0:1787836677.741988:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787836677.742015:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c378a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+5:2361:x1874682172278144:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00080000:0.0:1787836677.742023:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836677.742026:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:2.0:1787836677.742051:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172278528 00000100:00100000:2.0:1787836677.742055:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172278528 00000100:00100000:2.0:1787836677.742134:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:2.0:1787836677.742141:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e2c3788780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2361:x1874682172278400:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836677.742188:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e2c3788780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2361:x1874682172278400:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 46us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836677.742196:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:2.0:1787836677.742213:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1787836677.742222:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+8:2361:x1874682172278016:12345-192.168.203.25@tcp:400:kworker.0 00000100:00080000:0.0:1787836677.742237:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787836677.742252:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e9b6c886-a12b-46a3-a789-dc548bbc30a4+8:2361:x1874682172278016:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836677.742259:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1787836677.742271:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:2.0:1787836677.742276:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2361:x1874682172278528:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1787836677.742295:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+5:2361:x1874682172278528:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 19us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836677.742300:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:3.0:1787836677.743236:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172277888 00000100:00100000:3.0:1787836677.743252:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172277888 00000100:00100000:3.0:1787836677.743414:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:3.0:1787836677.743428:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:2361:x1874682172277888:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1787836677.743530:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303db8d1-2e8f-4f4f-8104-a67bc8426709+13:2361:x1874682172277888:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 93us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836677.743537:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:1.0:1787836677.743797:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682172278272 00000100:00100000:1.0:1787836677.743803:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682172278272 00000100:00100000:1.0:1787836677.743863:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:1.0:1787836677.743872:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fadd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2361:x1874682172278272:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1787836677.743912:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fadd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7302dfb5-a070-4ecc-a9fd-f6239036f535+6:2361:x1874682172278272:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 42us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787836677.743918:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00080000:0.0:1787836677.745920:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787836678.256643:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787836678.439717:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1787836678.439736:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1787836678.439744:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:02000400:0.0:1787836678.754554:0:16590:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1787836679.278278:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787836679.406539:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193231744:0@lo:400:kworker.0 00000100:00100000:3.0:1787836679.406543:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3313:1874682193231488:0@lo:400:kworker.0 00000100:00100000:0.0:1787836679.406627:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836679.406628:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836679.406701:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c828a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193232000:0@lo:400:kworker.0 00000100:00100000:3.0:1787836679.406734:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836679.406738:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193231360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787836679.406781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787836679.406800:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193231616:0@lo:400:kworker.0 00000100:00100000:3.0:1787836679.406840:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193232000 00000100:00100000:3.0:1787836679.406849:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193232000 00000100:00100000:0.0:1787836679.412983:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193232256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787836679.413371:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193231488 00000100:00100000:0.0:1787836679.413380:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193231488 00000100:00100000:0.0:1787836679.413428:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787836679.413437:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c8692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3313:x1874682193231488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787836679.413500:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c8692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54169f9e-8f3c-47d1-ba67-76dd190fcd61+19:3313:x1874682193231488:12345-0@lo:400:kworker.0 Request processed in 63us (6875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836679.413507:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787836679.413538:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193231744 00000100:00100000:0.0:1787836679.413541:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193231744 00000100:00100000:1.0:1787836679.419729:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836679.419788:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3c828b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193232128:0@lo:400:kworker.0 00000100:00100000:1.0:1787836679.419844:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787836679.419898:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193231616 00000100:00100000:1.0:1787836679.419919:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193231616 00000100:00100000:2.0:1787836679.430159:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98e3d3a62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193231872:0@lo:400:kworker.0 00000100:00100000:3.0:1787836679.430168:0:15736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193232128 00000100:00100000:3.0:1787836679.430178:0:15736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193232128 00000100:00100000:2.0:1787836679.430229:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836679.430312:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193231872 00000100:00100000:2.0:1787836679.430317:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193231872 00000100:00100000:2.0:1787836679.430340:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787836679.430350:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3c828bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193232000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836679.430417:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3c828bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874682193232000:12345-0@lo:400:kworker.0 Request processed in 68us (23683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836679.430425:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787836679.430442:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787836679.430449:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193231872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787836679.430480:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874682193231872:12345-0@lo:400:kworker.0 Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836679.430486:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787836679.430510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787836679.430659:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874682193231872:0@lo:400:kworker.0 00000100:00100000:2.0:1787836679.431939:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:54169f9e-8f3c-47d1-ba67-76dd190fcd61:3313:1874682193231488:0@lo:400:kworker.0 00000100:00100000:2.0:1787836679.431960:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c828a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874682193232000:0@lo:400:kworker.0 00000100:00100000:2.0:1787836679.432001:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193231360 00000100:00100000:2.0:1787836679.432012:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193231360 00000100:00100000:2.0:1787836679.432137:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874682193232256 00000100:00100000:2.0:1787836679.432140:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874682193232256 00000100:00100000:2.0:1787836679.432157:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787836679.432164:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3f5a88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193231360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787836679.432196:0:15011:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836679.432354:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3f5a88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874682193231360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (25573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836679.432366:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787836679.432384:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787836679.432391:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193232256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787836679.432414:0:15011:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787836679.432477:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e401fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874682193232256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787836679.432489:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787836679.432537:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193232256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787836679.432574:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787836679.432579:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98e3f5eea580, transno 8589934595 00000004:00080000:2.0:1787836679.432593:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787836679.432791:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874682193231360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787836679.442264:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787836679.442282:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3fae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193231744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836679.442644:0:15736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787836679.442653:0:15736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193232128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787836679.442746:0:15736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874682193232128:12345-0@lo:400:kworker.0 Request processed in 94us (22901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836679.442753:0:15736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787836679.442804:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3c828b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874682193232128:0@lo:400:kworker.0 00000100:00100000:0.0:1787836679.445645:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3fae830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874682193231744:12345-0@lo:400:kworker.0 Request processed in 3360us (39012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787836679.445660:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787836679.445715:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787836679.445720:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787836679.445723:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787836679.448175:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874682193231744:0@lo:400:kworker.0 00000100:00100000:1.0:1787836679.457535:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787836679.457552:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98e3d3ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193231616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787836679.457671:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98e3d3ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874682193231616:12345-0@lo:400:kworker.0 Request processed in 125us (37948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787836679.458845:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98e3d3a62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874682193231616:0@lo:400:kworker.0 00000100:00100000:1.0:1787836679.459183:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787836680.316794:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30246 lines, 30246 kept, 0 dropped, 0 bad.